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PERIODOGRAM ANALYSIS AND CONTINUOUS SPECTRA 
By M.S. BARTLETT, University of Manchester 


1. INTRODUCTION 


It has been realized for some time that the classical method of searching for periodicities in 
time series, the so-called periodogram analysis of the series, is useless in many cases. An 
alternative approach by way of the autoregressive or autocorrelative structure of the series 
was considered in a pioneering paper by Yule (1927), and more recently by other writers 
(see especially M. G. Kendall (1946)). 

A fuller understanding of the scope and relation of these methods is obtainable from the 
mathematical theory of stationary random or stochastic processes developed in the last 
twenty years by Wiener (1930), Khintchine (1934) and others (for an account of this theory 
see Lévy (1948), especially chapter 1v; for further reviews of the general theory of stochastic 
processes see also Cramér (1947), Moyal (1949)). By stationary is meant, roughly speaking, 
that the series is oscillating or fluctuating about a constant mean; more precisely, that its 
distributional properties in the stochastic sense do not depend on the absolute value of 
the time (note that a simple harmonic series is not stationary in this sense unless its initial 
phase is random). For many purposes in the correlation and harmonic theory of these 
processes it is sufficient to assume stationarity ‘to the second order’, that is, in addition to 
the mathematical expectation or stochastic average E{X(t)} = constant = 0, say, for the 
value of the series X at time ¢, the autocovariance function 

E(X*(t) X(t+7)} = w(7), (1) 
does not depend on ¢ and is a function only of the interval 7. (X*(¢) denotes in general the 
complex conjugate of X(t), though in the later application here of the theory it will be assumed 
that the series is real.) If X is standardized by dividing by its constant standard deviation a, 
assumed finite, equation (1) gives the autocorrelation function p{t) = w(7)/o*. 

If it is further assumed that X(t) is continuous in mean square, thai is, 


Lt E{| X(t+h)— X(t) |} = 0, 
h->0 


a condition easily seen to be equivalent to p(t) being continuous at 7 = 0, then it is known 
(cf. Khintchine, 1934) that the necessary and sufficient condition for p(r) to be a valid auto- 
correlation function is that it is expressible in the form 

p(T) =| e're dF (w), (2) 
where F(w) has the form of a cumulative distribution function, and is the integrated spectrum 
of the process. The corresponding theorem for processes defined only at discrete integral 


values of time is (Wold, 1938) ™ 
| ed Fw). (3) 


= 


Pr = 


Corresponding to (2), there is an equivalent relation for X(t) itself, associated with its 
harmonic analysis (first established in full generality by Cramér (1942; cf. Slutsky, 1938; 
see also Lévy, 1948, § 27, ch. Iv), namely, 
X(t) = | e dZ(w), (4) 
a 
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where the orthogonal stochastic process Z(w) has the property 
AF(w) = E{Z*(w+ Aw) AZ(w)} = E{AZ*(w) AZ(v)}, (5) 
where A denotes as usual a first difference, and the stochastic Stieltjes integral in (4) is defined 


as the limit in mean square of appropriate stochastic sums. 
Similarly, corresponding to (3), the relation is 


Xx, -{' has dZ(w). (6) 


2. THE SPECTRA OF LINEAR PROCESSES 


The relevance of the above results becomes clear when it is remembered that the general 
distribution function in (3) may consist of a discrete or continuous distribution, or of both. 
Only in the first case of a discrete distribution, apart perhaps from an additional purely 
random error or ‘noise’ leading to a wniform continuous distributional component, is the 
conception of a classical harmonic series valid. In general the possibility of any kind of 
continuous component to the spectrum must be allowed for. 

The very generality of these results becomes embarrassing when it comes to the analysis 
of actual series, and further assumptions about the character of the series are usually neces- 
sary in practice before much progress can be made—hence the importance of one general 
type of series distinct from the classical harmonic series and having a continuous spectrum. 
This was studied in a special case by Yule, but a much more general form, for which the term 
linear process has been used (Bartlett, 1946), is 


t 
Xw=[ ot-waY(u, (7) 
or for discrete time X,= r~. * (8) 


where the random ‘disturbances’ W, or d Y(w) are independent and stationary. It may readily 
be shown that when the coefficients g,_,, or g(t—) are such that X, or X(t) is well defined, 
then the series is stationary with autocorrelation function 


P; = of Sob duss/o% (9) 
or pir) = o8[” o*(u)g(u+r) duos, (10) 


where for convenience in these formulae w runs to — 00 with g, or g(u) =0 for u < 0, and where 
o3 is the variance of W, or, in the continuous time case, the variance of the integrated dis- 


t+1 
turbance over unit time, | dY(u). Hence if 
t 


the spectrum, obtainable from the autocorrelation function by ‘inverting’ the relation 
(3) or (4), is found to be continuous with probability density 


flw) = ofh(w) h*(w)/(270%). (11) 


ther 


For 
E{X 
give 


As1 
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) 


) 
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It should be noted that any stationary process with continuous spectrum can mathe- 
matically be expressed in the linear form 


X(t) = | * gt—w)d¥(u), (12) 


but, in contrast with (7), g(u) does not necessarily vanish for u < 0 (and similarly for formula 
(8) in the case of discrete time), and further the d Y(u) are uncorrelated (orthogonal) but not 
necessarily independent increments (see Karhunen, 1947). 

As an example, consider the simple autoregressive scheme 





Xi42+ GX, +X, = Wi. (a>0), (13) 
for which, from the solution of this difference equation for X,, 
Autl — wert 
ak i 14 
Stay aca (14) 


where A and y are the roots (assumed complex) of x?+axr+6 = 0. The ratio o/c? is given 
from (10) or (11) when 7 = 0, and it will be found that (cf. Bartlett, 1948) 
(1—6)(1—a? +b? + 2b) 
athe (1 +6) {1 +a? +b? — 26 + 2a(1 + 6) cosw + 46 cos? w} 

or if, as is more usual for real series, f(w)+f(—w) = 2f(w) is denoted by f,(w) defined for 
w > 0, the expression in (15) is 7f,(w). 

If it is known that a series is, say, of the simple type (13), its autoregressive constants 
a and 6 can be estimated, and hence the spectrum calculated from formulae such as (15). 
However, while it is possible to test approximately the goodness of fit of the corresponding 
calculated autocorrelation function or ‘correlogram’ when compared with the observed 
correlogram (Quenouille, 1947), it may be required to make a direct empirical study of the 
spectrum without any intermediate assumptions about its particular autoregressive struc- 
ture. 





(—7<w<n), (15) 


3. STOCHASTIC PROPERTIES OF THE PERIODOGRAM 


The classical analysis of a (discrete) series of n observations consists of computing the 
quantity f Qn 
H, = Ay+iB, = |= & X,etriorin (16) 


(by computing A, and B,), and hence the intensity I, = H, H}. The factor ./(2/n) has been 
inserted to make the mean value of J, equal to 20? for a completely random series. 


It is easily seen that nn 
r I, = , EY TVX,X,cosw(r—u), (17) 
Nr=Lu=1 
n—8s 
where w = 27p/n, orif C,= as > X,X,,, (s>0, C_,=C,), 
~ Opel 
a | s| 8 
then I,=2 D (1-+—)C,cosws. (18) 
s=—n+1 n 


For convenience it is still assumed that Z{X} = 0, but since formula (16) may be used when 

E{X} +0, the effect of this will be noted later. When H{X} = 0, the average of equation (18) 
ives n-1 

* E{I,} = 207 > (1 Np, cos ws. (19) 


s=—n+1 
As n increases, this tends for most values of w to 27a*f,(w), where f,(w) is the (continuous) 
spectrum of X,. 








4 Periodogram analysis and continuous spectra 


The usual periodogram argument considers what happens when X, contains a harmonic 
component of frequency Q, so that p, has a component Acos Qs. Since in this case the 
spectrum contains a discrete component at w = Q, it is evident that Z{J,} will tend to infinity 
at this point. This effect is well known, but is noted here for reference. The contribution may 
be evaluated as O(1/n) in general for w + Q, but O(n) at w = Q, and the analysis can resolve 
frequencies which differ by more than O(1/n). (The effect of not measuring X from E(X) 
is now apparent; it introduces a spurious component of this type at the origin w = 0.) 

It has also been recognized that as the intensity J, fluctuates about its mean value 
E(I,) = 207 for a completely random series, it is advisable when the significance of the 
periodogram peaks are considered to allow for such fluctuations, which are known to follow 


the probability law P{I, >2} = exp{—z/H(I,)}, (20) 


when X, is normal (se~, for example, Fisher, 1929). 

Once the possibility of continuous spectra, beyond the uniform ‘noise’ spectrum of the 
completely random process, is admitted, the situation is completely changed. Not only 
may a non-uniform continuous spectrum have peaks which may be comparable for a finite 
n with the value of Z{I,} even at the frequency Q of a discrete harmonic component, but the 
fluctuations in J, possess the remarkable property, exhibited in (20) in the particular case 
of the uniform spectrum, of being of the same order as the mean value E{J,} itself, irrespective 
of the length of series available for analysis. This has been noted by Slutsky (1937) and by 
P. J. Daniell (see the discussion to the paper by Bartlett, 1946), the second writer giving an 
explicit derivation which includes the property (also noted by Slutsky) that the covariance 
or correlation of J, and I, for p+q is in general of O(1/n?). To demonstrate further the 
approximate} validity of (20) for normal X, (or more generally for approximately normal 
A, and B,), it remains to show that the two components have equal variance and zero 
correlation, at least as n >00. To do this, consider Z{H?}. This is 

E 2 > > b cwirv) és me S eltitey” 5 | ato 
r=l1n=1 1 
92 n-1 ell 8|+2)tw (1— eXn—\8/) iw) 
"ie p 1— 2% 





202 > e2tw (elsito —e sl tw) 


a a A 1— et (for p integral) 





2q2 2-1 sin 
-— 2 pele. (21) 
This is exactly zero for p, = 0 (s +0); but it is also O/1/n) otherwise, provided that the sum 
Lp, sin | s| w converges as n>00. Since 
E{H}>} = E{A} — B3}+ 2H{A, B,}, 
the required results are thus established simultaneously. 


4. SMOOTHING THE PERIODOGRAM 
These results stress the futility of appraising the significance of peaks in I, 08 p varies by the 
classical method when the spectrum is continuous, but they do not indicate how the latter 
is to be estimated. In such a case the standard periodogram will exhibit a wildly fluctuating 


t It seems implied by Slutsky (1937, p. 133), without proof, that (20) still holds exactly, but this is 
clearly not so. 


21) 


um 
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appearance, a phenomenon which has often been observed in practice. Averaging over 
neighbouring values of p or w was suggested by P. J. Daniell, a device which might be 
especially useful in automatic electrical or optical analysis of a continuous record (for 
simplicity the theoretical fluctuation formulae have been discussed for a discrete series of 
n observations, but similar formulae apply to the continuous time case). For arithmetical 
analysis the following alternative procedure has been suggested (Bartlett, 1948). 

An average taken from m independent series ‘lengths’, if available, would possess the 
usual sampling property of its fluctuation being proportional to 1/,/m. If the lengths were 
taken consecutively as contiguous portions of one length of series, the correlation between 
quantities like H, derive! from different portions will be negligible as the length n of each 
portion increases, provided p, decreases fast enough as s increases. For example, even between 
adjacent portions, iii [s| 
E{H,(H3)'} =207 > (: = i) C Dern 

s=—n+1 n 
where H and H’ are obtained from the two portions, and this expression tends to zero as 
nm increases provided p, contains an exponential damping factor. Now averaging J, for the 
m subseries gives the formula 


= n~-1 — 
h=2 > (1-2!) cos, 


l m—in-—s 


XZ UArinuXricrnn (829). 


where C6 = 
m(N — 8) y=9 r=1 





This formula ignores, however, the information available in the interval s at the end of each 
subseries; if this is replaced by use of the covariance estimate from the whole data, the 
amended formula is pe 1s | 

[,(smoothed) = fas. ( aa C, cos ws, (22) 
where (, is obtained from the entire series. The choice of ” in this formulae (for given nm) is 
a compromise between reducing the fluctuations by the approximate factor 1/,/m and not 
reducing too much the resolving power, which depends on the value of n. Formula (22) is 
related to the harmonic analysis of the correlogram (cf. D. G. Kendall, 1948), which would 
often have been calculated already, and it is sometimes convet.ient to use the sample auto- 
correlation R, in place of C,. In either case it is usually advisable to eliminate the spurious 
component at w = 0 by measuring X from the series mean. 


5. EMPIRICAL VERIFICATION 


Empirical verification of the validity of the suggested procedure was carried out on 
M. G. Kendall’s artificial series (loc. cit.), for which the theoretical spectra can be calculated 
by means of formula (15). Some preliminary calculations reported earlier (Bartlett, 1948) 
also tested a cruder form of formula (22) in which the factor 1 — | s |/n was dropped. This was 
found, however, to lead to relatively small but systematic oscillations which are best avoided. 
It was also found that the differences between working with correlations and covariances 
appeared negligible, and it was preferred to work with the covariances (using for this purpose 
sums of squares and products kindly supplied by M. G. Kendall). Since the artificial series 
were already measured from the mean, no correction for the mean was necessary. 








6 Periodogram analysis and continuous spectra 


Series I and III were selected as representative cases, and after testing out formula (22) 
on the whole series further calculations on subseries were made to check the order of both 
systematic and random fluctuations of the smoothed periodogram from the true spectrum. 
For reference the values of a and b for the two series are: 

Series I (total length 480 terms): a=-1l11, b6=05. 


Series III (total length 240 terms): a=-1-1, 5 = 0-8. 


The distribution of the random disturbance W for these series was rectangular, not normal, 
but this does not affect the asymptotic distributional theory of H,, as n increases. 





120} 
True spectrum — ee x 
ae Smeothed periodogram 
n=15 wnenacesee 
n=30 ceoveo.eeccecsocgee soceee 
Unsmoothed (M. G. Kendall) 
80 
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Fig. 1. Periodogram analysis of Series I—smoothed periodograms (n = 15 and 30) 
and unsmoothed (M. G. Kendall), compared with true spectrum. 


In formula (22) the choice of n = 15, 30 and 45 for Series I gave m = 32, 16 and 12% respec- 
tively when the total length was used; and m = 15 and 30 for Series III gave m = 16 and 8. 
Similar calculations on subseries lengths of 60 terms for n = 15 and 30 corresponded of 
course to smaller m and hence larger fluctuations—m = 4 and 2 respectively for both series 
(these subseries calculations were confined to the more interesting half of the frequency 
range containing the peak of the spectrum). 

The results of these computations are given in Appendix A (Tables 5-10). The intensity 
I was suitably standardized in the case of the covariance calculations by division by the value 
of the variance o?, and hence was comparable to 27f,,(w), also shown in Tables 5 and 6. The 
values were calculated for g=30w/7 running from 1 to 30 (the corresponding values of p 
are 4nw/7 = nq/60). The results for the total series are also illustrated in Figs. 1 and 2, which 
show the smoothed periodograms for Series I and III respectiveiy (n = 15 and 30) together 





(22) 
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with the true spectrum. In the case of Series I some values of the unsmoothed periodogram 
(suitably adapted from Table 4-1, M. G. Kendall (1946)) are also plotted for comparison. 

In order to examine the extent of validity of formula (20) and the smoothing properties 
of (22), it is first noted from (20) that [,/H(I,) is approximately a x? with 2 D.¥. and fluctua- 
tions in any smoothed periodogram would consequently be expected to be roughly equivalent 
to x? distributions with 4, 8, etc., degrees of freedom according to the smoothing adopted. 
This could be tested by means of an appropriate adaptation of the homogeneity of variances 
test (Bartlett, 1937). To cover deviations in both I, and E(J,,) the values of J, = I,,/[270°f,(w)] 
were evaluated over the range for which the smoothed periodograms for the subseries had 
been computed. Since the subseries lengths were all 60, the case n = 30 should correspond 
to x*’s with 4D.F., n = 15 to 8D.¥. 
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Fig. 2. Smoothed periodograms (n = 15 and 30) for Series III, compared with true spectrum. 


In the case of Series I, this was almost completely verified. The over-all fluctuations were 
split up into fluctuations at any frequency w and systematic deviations of the average at any 


frequency, i.e. log J, = log (J,,/J,,) + log J,,. 


The values of J,, could further be compared with the average over p, J, say, the average J, 
being tested separately. The analyses given in Tables 1 and 2 were obtained. 

It will be seen that the only significant (P = 0-05) departure from the asymptotic dis- 
tribution was in the systematic deviations J, for n = 15. This may be due to a real bias 
(cf. the results below for Series III), but might also be partly due to the periodogram being 
evaluated for integral q, which for n = 15 corresponds to quarter-integers for p; this would 
imply considerable correlation between neighbouring points even for a completely random 
series, whereas the above test assumes independence. 

In the case of Series ITI it will be noticed that the amplitude of the peak of the smoothed 
periodogram fails to reach the ‘true value’, especially for = 15. That this is a real 
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Tables 1 and 2. Analysis of fluctuations by approximate y? test 
































Series I. n=30. 
D.F Crude x? Corrected x? 
JJ 5 105 128-38 — 
J 5/J 5 14 17-84 _ 
J, 1 0-16 — 
Total 120 146-38 135-12 
Series I. n= 15. 
D.F Crude x? Corrected x? 
J5/J 5 105 96-62 a= 
J y/J 5 } 14 25-91 24-81 
J>5 / 1 1-21 — 
i 
Total / 120 122-74 — 














/ 


s 


f 


+ Significant at P=0-05 level. 


— 240m log J, + 240m(J,—1). 


Similarly, the correcting, factor foe the total x? is 1+ 


1 13 
6m 


Tables 3 and 4 


Note. For a test of J, fhe unconditional likelihood function is required, the corresponding crude 
*for an average of 8 x 1&/= 120 items being 


— = 72 for n= 30, m= 2. 





























Series III. n=30. 
D.F Crude x? | 
J5/J 5 45 27-71 
J,/J 5 14 178-08t 
J, 1 6-01f 
Total 60 211-80 
Series ITI. n=15. 
DF Crude x? 
Jj» 45 27-78 
J,/J, 14 319-83 
J, 1 31-58 
Total 60 379-16 











t Significant at P=0-01 level. 


rude 
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systematic error due to the short length of the equivalent length of series may be checked 
from the corresponding analysis of the fluctuations for the subseries (Tibles 3 and 4). 

This damping of the peak must, however, be expected for comparatively small n in the 
case of series with little-damped oscillations. It will be remembered that in the case of 
classical harmonic analysis with a discrete spectrum the true amplitude (with this standardi- 
zation) would be infinite, whereas that of the periodogram would still be finite, and the 
smaller and less well resolved the fewer the observations. 


10 


i 


Fig. 3. Correlogram of Wolfer’s sunspot numbers (Yule’s graduated series, 1749-1924). 


Rs 








It may be concluded that with the present method of estimating a continuous spectrum 
by smoothing the periodogram excessive curtailing of the correlogram is inadvisable if the 
amplitude of the peak is to be estimated as well as its location. The estimated spectrum is in 
general a consistent rather than a strictly unbiased estimate, approaching the true spectrum 
if the series is large enough for adequate smoothing and yet n is also large enough. The 
value of n to take may (cf. Bartlett, 1948) be judged from the amount of damping in the 
correlogram. 

Among subsidiary effects in the above y? analysis for Series III will be noted (i) a tendency 
for fluctuations about J, to be less than expected on the asymptotic theory, and (ii) a mean 
bias J,, especially for n = 15. 


6. SMOOTHED PERIODOGRAM FOR WOLFER’S SUNSPOT NUMBERS 


This method of smoothing the periodogram was also tried out on Wolfer’s sunspot numbers 
as an example of an actual series, in contrast with the artificial series discussed above. This 
series was the first to be analysed by the autoregressive method.(Yule, 1927), and for com- 
parative purposes the present analysis uses the same (graduated) series studied by Yule, 
i.e. from 1749 to 1924. The observed values of R,, for s = 1... 23, are givent in Appendix B 


+ There are some trivial differences between these values and those given by Yule for s = 1... 5, 
possibly due to the formulae or method of computation used. 
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(Table 11) and in Fig. 3. Yule’s graduated values were used because previous analysis by 
Yule and by the author (Bartlett, 1946) respectively suggested that these values might 
correspond to an autoregressive model of type (13), or to the corresponding analogue defined 
for continuous time. However, the calculation of the more complete correlogram established 
the untenability of either assumption, at least in this simple form (e.g. by Quenouille’s x? 
test in the case of the discrete time model, and, in the case of continuous time, by an adapta- 
tion of it to be reported elsewhere in collaboration with P. H. Diananda). 

But in spite of the absence of any simple adequate autoregressive model, the series is one, 
as Yule pointed out, for which classical harmonic analysis is of doubtful value, although 
periodogram analysis of the series has from time to time been made (Schuster, 1906; Larmor 
& Yamaga, 1917). In order to investigate its spectrum without a knowledge of the under- 
lying mechanism, the smoothed periodogram (with n = 24) was calculated for q = 88w/7 


F 


a Ihr? 
T 








: l i i l 
0 5 19 15 20 25 
q =88w/7 


Fig. 4. Smoothed periodogram (n = 24) of Wolfer’s sunspot numbers. 


from 1 to 30 and is given in Appendix B (Table 12) and Fig. 4. There is a rise towards w = 0; 
in spite of possible small contributions due to the incomplete elimination of the mean or to 
the effect of the graduation this suggests a real component of non-oscillatory or ‘Markoff’ 
type, and indicates how a somewhat better fit might be obtained for the correlogram by 
addition of such a component to any theoretical model for the process. As such an empirical 
extension of the autoregressive model does not greatly contribute to the interpretation of 
the observed data it is not pursued in any detail, but it may be of interest to note Sir Gilbert 
Walker’s somewhat similar calculations on the correlogram of a meteorological series in 
his search for empirical fits (Walker, 1931). 

Apart from its behaviour at the origin, the spectrum over the interesting range consists 
of a single smooth humpbacked curve with a peak at about 11-0 years’ ‘period’, in agreement 
with the usually accepted value of the period. 
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7. CONCLUSIONS 


The discussion in this paper has emphasized that the more comprehensive theory of periodi- 
city in time series now available throws up problems in sampling theory of considerable 
complexity and, up to recently, largely ignored. While other branches of mathematical 
statistics have developed an extensive distributional theory of sampling variability, in 
contrast with the earlier ‘large-sample’ theory, the sampling theory of time series is on the 
whole still in the more primitive ‘large-sample’ state. The estimation and assessment of 


accuracy of autoregressive constants and the goodness of fit test of the correlogram fall into 
this category. 

















10 1S 
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Fig. 5. Smoothed periodograms (nm = 15) of subseries (i) and (ii) (Series I). 


It has been pointed out that some method of smoothing the periodogram of a series with 
continuous spectrum is essential, as the classical method gives no convergence to the true 
spectrum. While the method recommended above also falls into the ‘large-sample’ category, 
and no precise tests of the significance or accuracy of any observed peaks have been derived, 
the value of the method would appear to have been established by the above examples. On 
short series the amount of smoothing possible will not be sufficient to prevent extensive 
«sampling fluctuations from one ‘sample’ to another, as is illustrated in Fig. 5, which shows 
two contrasted curves for subseries (i) and (ii) (Series I), of total length 60, differing greatly 
in their evidence for ‘periodicity’. The order of magnitude of the fluctuations is, however, 
known, ranging from the asymptotic formula (20) in the case of the unsmoothed periodogram 
to the 1/,/m reduction factor when smoothing is adopted. The order of correlation and 
resolution for different frequencies is also known, both depending on n. This allows a rough 
assessment of significance of variation in amplitude to be made, and would if used earlier 
at least have prevented the many doubtful claims of multiple periods to be found in the 
literature (for example, by Brownlee (1917) in the case of the periodicity of measles epidemics). 
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SUMMARY 


The problem of investigating periodicity in time series is considered in the light of theoretical 
developments in the harmonic analysis of stationary stochastic processes; it is for series with 
continuous spectra that classical periodogram analysis is often useless and misleading. 

A proposed method of smoothing the periodogram, making use of the correlogram, is 
tested arithmetically on two of M. G. Kendall’s artificial series, and a statistical analysis made 
of the fluctuations in the smoothed periodograms. The method is also tested on Wolfer’s 
sunspot numbers. These empirical tests supplement a theoretical discussion of the asymptotic 
properties of the method. 


I am indebted to Miss R. M. Dyson for most of the computational work involved in this 
investigation. 


APPENDIX A 


Smoothed periodograms for M.G. Kendall’s artificial Series I and III (standardized to nf ,(w) 
and tabulated for integral values of q¢ = 30w/7) 




















Table 5 
Series I. Total series. 
From correlations _ From covariances 
q True 
values 
n= 45 n= 30 n=15 n= 45 n= 30 n= 15 
1 3-208 2-936 2-913 3-192 2-938 2-915 2-219 
2 3-082 3-247 3-083 2-994 3-254 3-089 2-380 
3 3-809 3-505 3-058 3-884 3-517 3-065 2-656 
4 2-821 2-899 2-821 2-893 2-905 2-827 3-030 
5 2-293 2-297 2-593 2-204 2-294 2-594 3-395 
6 2-359 2-474 2-485 2-331 2-477 2-489 3-493 
7 3-026 2-785 2-366 3-135 2-792 | 2-370 3-091 
8 2-408 2-368 2-045 2-890 2-371 | 2-045 2-353 
9 1-198 1-251 1-547 1-168 1-247 1-499 1-641 = 
10 0-763 0-889 1-092 0-811 0-887 1-091 1-118 
ll 0-930 0-847 0-879 1-606 0-848 0-822 0-773 
12 0-630 0-686 0-684 0-548 0-687 0-684 0-549 
13 0-478 0-488 0-557 0-432 0-485 0-556 0-403 
14 0-344 0-348 0-411 0-435 0-343 0-408 0-305 
15 0-180 0-216 0-289 0-180 0-216 0-288 0-237 L 
16 0-183 0-195 0-225 0-087 0-199 0-227 0-190 
17 0-154 0-158 0-199 0-196 0-159 0-199 0-155 
18 0-099 0-123 0-176 0-179 0-123 0-177 0-130 
19 0-140 0-135 0-217 0-056 0-135 0-160 0-111 
20 0-139 0-143 0-153 0-088 0-143 0-153 0-096 
21 0-109 0-122 0-147 0-203 0-121 0-146 0-085 
22 0-114 0-111 0-130 0-124 0-111 | 0-129 0-076 
23 0-066 0-081 0-108 —0-036 | 0-080 0-107 0-069 
24 0-066 0-067 0-093 0-097 0-070 0-092 0-064 
25 0-059 0-066 0-089 0-142 0-063 | 0-085 0-059 
26 0-052 0-062 0-685 — 0-018 0-058 | 0-081 0-056 
27 0-056 | 0-058 0-079 — 0-008 0-054 | 0-076 0-054 
28 0-049 | 0-060 0-076 0-142 | 0057 | 0-074 0-053 
29 0-055 0-057 0-077 0-065 0-055 0-075 0-052 
30 0-048 0-058 0-077 — 0-051 0-058 | 0-077 0-051 
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Table 6 
Series III. Total series. 
q n= 30 n=15 True values 

1 0-523 0-630 0-473 

2 0-716 0-774 0-515 

3 0-937 0-882 0-596 

4 1-035 1-046 0-745 

5 1-290 1-555 1-023 

6 1-881 2-560 1-603 

7 4-113 3-758 3-031 

8 6-262 4-496 6-835 

9 4-672 4-309 8-079 

10 3-257 3-330 3-222 

ll 2-171 2-138 1-337 

12 0-993 1-234 0-680 

13 0-534 0-721 0-399 

14 0-257 0-450 0-259 

15 0-223 0-291 0-180 

16 0-158 0-215 0-133 

17 0-156 0-162 0-102 

18 0-107 0-181 0-081 

19 0-107 0-152 0-067 

20 0-129 0-134 0-056 

21 0-119 0-129 0-048 

22 0-063 0-114 0-042 

23 0-054 0-083 0-038 

24 0-039 0-066 0-035 

25 0-055 0-074 0-032 

26 0-057 0-082 0-030 

27 0-051 0-070 0-029 

28 0-034 0-058 0-028 

29 0-047 0-064 0-027 

30 0-045 0-071 0-027 

” 
Table 7 
Series I. »=30. 
Subseries of 60 terms 
Total 
q } series 
(i) (ii) (iii) (iv) (vps | (vi) (vii) | (viii) | Average 

1 4-792 0-678 2-682 1-346 1-760 2-922 6-480 2-566 2-903 2-938 
2 2-092 0-547 3-279 2-651 2-433 4-097 11-944 2-452 3-687 3-254 
3 2-274 0-952 1-782 2-673 3-671 3-467 6-302 6-611 3-466 3°517 
4 1-718 2-043 1-106 1-460 2-601 3021 1-364 7-082 2-549 2-905 
5 0-875 1-057 0-589 2-200 1-015 1-780 3-412 5-833 2-095 2-294 
6 0-716 1-159 2-183 4-046 1-486 3-830 3-637 3-005 2-508 2-477 
7 0-728 6-812 3-060 3-261 3-954 4-413 1-749 0-774 3-094 2-792 
8 0-937 6-158 1-192 1-499 3°324 3-581 0-405 0-989 2-261 2-371 
9 1-143 1-099 0-411 2-928 0-684 1-873 0-400 0-382 1-115 1-247 
10 0-572 0-750 0-409 2-292 0-382 0-321 0-586 0-703 0-752 0-887 
ll 0-339 1-687 0-414 0-781 0-396 1-017 1-389 0-763 0-848 0-848 
12 0-451 1-398 0-537 0-508 1-050 0-832 0-568 0-582 0-741 0-687 
13 | 0-349 0-502 0-457 0-346 0-761 0-631 0-547 0-180 0-472 0-485 
14 0-376 0-251 0-315 0-447 0-178 0-389 0-397 0-365 0-340 0-343 
15 0-379 | 0-064 0-192 0-172 0-117 0-292 0-486 0-213 0-239 0-216 
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Table 8 
Series I. n=15. 
Subseries of 60 terms 
Total 
q series 
(i) (ii) (iii) (iv) (v) (vi) (vii) (viii) | Average 
1 5-176 0-699 2-784 1-792 1-978 2-731 6483 2-785 3-054 2-915 
2 3-586 0-996 2-637 2-041 2-523 3-189 6°836 3-987 3°224 3-089 
3 2-172 1-068 2-169 2-240 2-624 3-246 6-098 5-314 3-116 3-065 
4 1-448 1-156 1-646 2-396 2-249 2-566 4°427 5-867 2-720 2-827 
5 1095 | 1-829 1-514 2-604 1-999 2-903 2-985 5-097 2-503 2-594 
6 0-997 3-078 1-768 2-809 2-228 3-257 2-346 3-380 2-483 2-489 
7 0-863 4-051 1-878 2-817 2-540 3-487 1-974 1-732 2-418 2-370 
8 0-855 3-913 1-504 2-541 2-320 3-038 1-319 0-881 2-046 2-045 
9 0-869 2-797 0-874 2-097 1-554 2-060 0-652 0-737 1-455 1-499 
10 0-742 1-624 0-470 1-617 0-822 1-199 0-476 0-776 0-966 1-091 
ll 0-520 1-066 0-431 1-135 0-572 0-834 0-676 0-692 0-741 0-822 
12 0-389 0-969 0-508 0-687 0-658 0-782 0-752 0-537 0-660 0-684 
13 0-398 0-817 0-476 0-382 0-666 0-698 0-573 0-426 0-555 0-556 
14 0-419 0-461 0-365 0-280 0-459 0-490 0-460 0-358 0-412 0-408 
15 0-353 0-169 0-296 0-280 9-235 0-289 0-409 0-298 0-291 0-288 
{ 
Table 9 
Series III. n=30. 
Subseries of 60 terms 
Total 
q series 
(i) (ii) (iii) (iv) Average 
1 0-101 0-561 0-318 0-740 0-430 0-523 
2 0-705 0-482 0-416 0-169 0-443 0-716 
3 1-727 1-229 0-890 0-436 1-070 0-937 
4 1-211 0-980 0-772 0-936 0-975 1-035 
5 1-550 0-608 1-482 1-400 1-260 1-290 
6 3-056 1-143 2-395 0-530 1-781 1-881 
7 2-208 4-017 7-830 5-398 4-863 4/113 
3 3-212 5-039 8-274 7-413 f-OR5 8-262 
9 4-543 1-959 4-753 3-640 3-724 | 4-672 
10 2-434 1-198 6-008 3-212 3-213 3-257 
11 1-372 1-173 2-939 3-676 2-290 2-171 
12 0-593 1-013 0-919 1-415 0-985 | 0-993 
13 0-223 0-927 0-549 1-329 0-757 0534 
14 0-189 0-444 0-393 0-258 0-321 0-257 
15 0-050 0-247 0-320 0-211 0-207 0-223 
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Table 10 
Series III. n=15. 
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Subseries of 60 terms 
Total 
q series 
(i) (ii) (iii) (iv) Average 
1 0-501 0-653 0-466 0-809 0-607 0-630 
2 0-834 0-830 0-670 0-751 0-771 0-774 
3 1-222 0:787 0-776 0-642 0-857 0-882 
4 1-549 0-752 1-060 0-773 1-033 1-046 
5 1-842 1-136 2-044 1-544 1-642 1-555 
6 2-227 2-046 3-772 2-968 2-754 2-560 
7 2-731 2-962 5-518 4-433 3-911 3-758 
8 3-129 3-189 6-347 5-131 4-449 4-496 
9 3-093 2-590 5-893 4-747 4-081 4-309 
10 2-504 1-698 4-538 3-662 3-161 3-330 
ll 1-612 1-112 2-968 2-505 2-049 2-138 
12 0-822 0-928 1-686 1-615 1-263 1-234 
13 0-378 0-834 0-877 0-977 0-766 0-721 
14 0-239 0-612 0-488 0-518 0-464 0-450 
15 0-233 0-351 0-355 0-264 0-301 0-291 
APPENDIX B 


Table 11. Correlogram of Wolfer’s sunspot numbers (Yule’s graduated series, 1749-1924) 








8 R, 8 R, 8 R, 

1 0-8408 9 0-3646 17 — 02683 
2 0-4715 10 0-5197 18 —0-2179 
3 0-0470 ll 0-5273 19 — 0-1256 
4 — 0-2647 12 0-3937 20 — 0-0096 
5 — 0-4059 13 0-1791 21 0-1143 
6 — 0-3601 14 — 0-0390 22 0-2035 
7 — 0-1636 15 — 01947 23 0-2132 
8 0-1088 16 — 02706 


























Table 12. Smoothed periodogram (n = 24) of Wolfer’s sunspot numbers 
(standardized to nf ,(w) and tabulated for q = 88w/7) 





























q q q 
1 3-259 11 1-854 21 3-047 
2 3-138 12 2-792 22 2-237 
3 2-927 13 3-913 23 1-629 
4 2-621 14 5-017 24 1-203 
5 2-231 15 ' 883 25 0-921 
6 1-790 16 6-339 26 0-714 
7 1-366 17 6-304 27 0-589 
8 1-060 18 5-809 28 0-489 
9 0-985 19 4-382 29 0-426 

10 1-237 20 4-004 30 0-398 

t 
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NOTES ON CONTINUOUS STOCHASTIC PHENOMENA 
By P. A. P. MORAN, Insiitute of Statistics, Oxford University 


The study of stochastic processes has naturally led to the consideration of stochastic pheno- 
mena which are distributed in space of two or more dimensions. Such investigations are, for 
instance, of practical interest in connexion with problems concerning the distribution of soil 
fertility over a field or the relations between the velocities at different points in a turbulent 
fluid. A review of such work with many references has recently been given by Ghosh (1949) 
(see also Matérn, 1947). In the present note I consider two problems arising in the two- and 
three-dimensional cases. 


RELATIONS BETWEEN CONTINUOUS AND DISCONTINUOUS PROCESSES 


Stochastic variables defined for points on a plane may be considered as defined at a discrete 
set of points (for example, at all points with integral co-ordinates) or for a continuous domain 
of points. The latter is the natural approach when considering soil fertility, but in the study 
of the efficiency of experimental designs it is more natural to consider the fertility as varying 
discontinuously from plot to plot rather than within each plot. For this reason I begin by 
considering the relationship between continuous and discrete models of such phenomena. 

First consider stationary stochastic processes in one dimension defined by variates x(t), 
where ¢ is ‘time’ and takes either integral or a continuous range of values. Continuous 
processes whose variate x(t) has a correlation function 


p(t) = exp[—A|é|] (1) 
are known (Bartlett, 1947, p. 79) to exist and to have a spectrai density given by 
‘ 2A 
W'(0) = =a Bm (2) 
° © cos t0dé 
so that p(t) = I. cos t@dW(@) = 2a” mA? + 63)" 


From such a continuous process, a discrete process can be derived in two ways. First we 
might consider the values of x(t) only at discrete values of ¢ (= 0, +1, ... say). Such a process 
would have the serial correlation 


p, =exp[—A|s{] (s=0, +],...), 
and could be regarded as being generated by a simple Markoff relation of the form 
i Bape dns Lest Ms 


where {7,} is a stationary process which is not necessarily completely random but never- 
theless has all its serial correlations zero. 

In practice it is perhaps more realistic to consider. discrete processes derived from con- 
tinuous ones in another way. Suppose we write 


8+1 
X(s) = i) , a(t) dt, (3) 
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where s takes values 0, +1, ... and the integral is a ‘stochastic integral’. A completely 
rigorous discussion of this definition would be neither short nor (in the present connexion) 
very illuminating, and we do not enter into such considerations here. (For a general dis- 
cussion of such questions see Lévy, 1948.) It is clear that p(t) is continuous at ¢ = 0 and con- 
sequently x(t) is ‘stochastically continuous’ (Bartlett, 1947, p. 77). To discuss the correla- 
tional and spectral properties of X(s) we may therefore argue as follows. We approximate to 


X(s) = | °F a(t) dt 


by a sum, and to find var X(s) and cov {X(s), X(s+k)}, we take the expectations of the sums 
and proceed to the limit. In this way we find 


1 fl 
var X(s) = B(X(s)}* = | da | dbexp[—A|a—6|] 
0 Jo 


2 
= pa 1 +e}. 
Similarly, for k>1 
1 1 
E{X(s) X(s—k)} = E{X(s) X(s+k)} -| da dbexp[—A|k+b-a]] 
0 0 


= ue (e*—1)(1—e-). 


Thus p; (k > 1), the serial correlation of X(s) and X(s+k), is given by 


ot _ eA (eh — 1)(1—e-4) 
P= P-K= 2(A—1+e-) 





= Ae-*k, gay. (4) 


Then as A 0, p, > 1 and as A, p, > 0 as we expect. Now, using the fact that 


sinhA = }(e4—e-*)>A for A>9O, 
it can be easily shown that 
(e-4— 1) (1—e) > AA—1+e-), 
and therefore A>l. 


On the other hand, it is easily verified algebraically that p, = Ae~*<1. Formula (4) is not 
the sort of correlation function which would be obtained for a process which is the solution 
of a simple stochastic difference equation of Markoff type because A > 1, but we may con- 
struct a simple mechanism which would generate a process having the above correlational 
properties. Write r = e~*. Then the serial correlation generating function of the process 
X(s) is «o rs) ro) 
D Pez® = 14+ AD rk2*¥+ Ad rez 

a) i 1 

Arz  Arz-} 

l—-rz 1—rz-} 
_ 14+9r?-2Ar?+(A—1)rz+(A—1)rz7 
Fs (l—rz)(l—rzt) 

_ (a+ Bz) (a+ fz) 


~ (l=rz)(l-rz7) ’ 


where a, 8 = H{(1—r)?+2Ar(1—r)}¥ + H{(1+7r)?-2Ar(1+r)}. 


1+ 
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a and # can be easily verified algebraically to be real. Then if {£,,} is a sequence of indepen- 
dent random variables with zero means and the same standard deviation, the process {Y,,} 
ted i 
generated by the relation Yiuy = 1¥,, 4-08, + PEs, 


will have the same correlational properties as {X,,}. 

We now consider what happens when we generalize the above to ‘processes’ with more 
than one ‘time’. As the idea of a continuing ‘ process’ is now less applicable we shall call such 
a model a ‘spatial stochastic system’. We consider such a system to be defined if for any set 
of points A, ..., Fj, in such a plane (or higher dimensional space) there is given a set of random 
variables 2, ..., x, and a corresponding joint distribution function F(2,, ..., 2) which satisfies 
the customary consistency conditions that the joint distribution of any set of 2’s, 2,,...,%p 
(p<k) is obtained from the joint distribution of ,,...,7, by integrating out ,,1,..., 2%. 
This condition corresponds to the Chapman-Kolmogoroff equation in the theory of processes 
with a single ‘time’. If the distribution function F(z,, ...,x;,) is invariant under any trans- 
lation of the set of points P,, ..., PR, we call the system ‘stationary’, and if, in addition, it is 
invariant under any rotation we call it ‘isotropic’. If we only know that the first- and second- 
order moments of x,, ...,2;, are invariant under such a translation (or rotation), we say the 
system is stationary (or isotropic) to the second order. In what follows we consider stationary 
processes, but the results obviously hold under the weaker condition also. 

Suppose the variates defined so that each has zero expectation and variance o*. Con- 
sidering first systems in two dimensions we take two parameters ¢ and u to correspond to the 
‘times’, and we then have a correlation function 


p(p,q) = correlation {x(t, wu), x(t+p,u+q)}. 
It follows that P(P,9) = P(—P, —9), 
but it is not necessarily true that 
pP(p,a) =p(p,—-g) or p(—p,4q). 


The latter relations would be true if the system were isotropic, but they are not a sufficient 
condition for isotropy. 
The natural generalization of processes with a correlational function (1) would be a system 
whose correlational function is 
p( p,q) = exp[—A(p?+9")]. (5) 
As will be seen later it is easy to show that such systems exist. Now suppose we derive 
from a continuous system having (5) as correlation function, a two-dimensional discrete 
system defined by a system of variables X,,,, where J, m take integral values, and X,,, is 


defined by 1+1 Pm+1 
Xim = i | x(t, u) dtdu. 
I m 


Following our previous argument we might expect that we should have a correlation 
function which generalizes (5), i.e. of the form (5) multiplied by a constant. That this is not 
true can be seen as follows. If the result were true, the covariance of X,,, and X;,5 msg 
would be of the form Kexp[—p(p?-+9")4], 


where X is some constant and y is not necessarily equal to A. It would then follow that 


T = exp[u(p*+*)#] cov (Xz ms Xi+p,m+g) 
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would be independent of p and q. Taking in particular the case q = 0, this is equal to 
1 1 1 1 
T= [ at, [’ du, {' at, | du, exp {up —Al(p +t, —t)? + (ue — uy)? }}. 


Then = I, dt, | du, [ dt, | dug exp {up —Al( p+ ty— ty)? + (ug— uy)*}} 


see Sa 
{(p + te —t)? + (Ug —U,)?}# 

If 4 >A the second factor is greater than zero over the whole range of integration with the 
possible exception of the points where u,=,, and so the whole integral is non-zero, which 
contradicts the hypothesis. On the other hand, if «7 < A we can choose p so large that over the 
whole range of integration the second factor is negative, again contradicting the hypothesis. 
Thus this generalization of the previous argument breaks down. 

It follows that in cases where it is necessary to derive a discrete system from a continuous 
one, in the above manner, it would be more convenient, if perhaps occasionally less realistic, 
to consider systems with a correlation function 


p(p.49) = exp[—A| p|—-z\4]]. (8) 
It is easy to see that in this case the discrete process X, ,,, has a correlation function 
Pu = A,A, pgerecabagd: 








_ (=e) 
where A, ae 

te (e*— 1) (1—e-“) 
and A,= Hu-1+eF ’ 


when neither & nor / is equal to zero. When one is equal to zero the formula is modified. 

Cases where correlation functions of this kind can plausibly arise are those in which we 
might attempt to study the relative efficiencies of various experimental designs assuming 
that soil fertility is a random variable with a spatial correlation of the form (6). 

The existence of spatial stochastic systems with prescribed correlation functions follows 
from the two- (or more) dimensional analogue of Khintchine’s theorem. This asserts that 
a necessary and sufficient condition for the existence of a spatial stochastic system with 
a correlation function p(p, q) is that there exist a function W(x, y), non-decreasing in z and y, 
such that ioe 
p(p.q)={"_ |” etommraw(a,y) 

—-O/ —-@ 


and : fr dW(x,y) = 1. 


The sufficiency of this condition is easily proved by a simple generalization of Khintchine’s 
method (1934) of constructing a stochastic process whose correlation function is the desired 
one, whilst the necessity follows from a theorem of H. Cramér (1939) (see also Lévy, 1948). 
W (x,y) can then be found in terms of p( p,q) by a Fourier inversion formula and in particular 
if the system is isotropie, W,,(x,y), if it exists, will be a function of (x? + y*) only. 

We can thus prove that exp [—A(p?+q?)#] is a possible correlation function (as proved in 
Matérn, 1947, p. 27). It is clearly sufficient to take A = 1. We then verify that W(z,y) can 


be taken as dudr 
=I. 4 ow (1+u?+r2)i 
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‘ = ekpr+aw) da dy 
Consider wl.) .aeereas (l+a2+ yh" 
Write z=tcosa, y=tsina, p=acosf, g=asin£. 


The above is then equal to 


ma t eta co8(a—£) 
=, at | aa (1+ (1+8)F- 


dt eee 
“inl l, (1+#)t* 





1 2m 
Now J,(ta) = =|, eMeows da 
(Whittaker and Watson, 1935, p. 364), and so the above integral is equal to 
tJ, (ta 
Wiexone 
Now it is known that ©tJ,(ta)dt atK(a) 
J o (1+e)F 2G)" 


This formula can be obtained by putting v = 0, uw = } in formula (7-11-6) of Titchmarsh 
(1937, p. 201). But a\t 
K,(z) — (=) e*, 


and so the above integral equals e~* = exp [ — (p? + g?)#]. The above method of argument can 
be easily generalized to three dimensions and exp[—A(p?+q?+,r?)*] can be shown to be 
a possible correlation function. This type of function gives a satisfactory representation of 
the correlation between velocities in certain cases of turbulence, and it may here be pointed 
out that the spectral theory of turbulence has recently been developed in a very elegant form 
by Batchelor (1949). 

By using an inversion formula we also see that in two or more dimensions, if the system is 
isotropic, W(x, y, ...) will be a function of z?+y?+... only, and by integrating first over all 
directions, we see that for isotropic processes the correlation function will always be repre- 


sentable as a Fourier-Bessel-Stieltjes integral of the type 5 J,,(ut) td F(t). 
0 


TEST OF THE EXISTENCE OF TWO DIMENSIONAL STOCHASTIC SCHEMES 


Another problem arises in practice when we are given a set of variates X, ; (i, 7 taking in- 
tegral values), and we wish to decide whether there is any evidence that these variates are 
spatially correlated. Such a case can arise, for example, in uniformity trials in agricultural 
research. This is the two-dimensional analogue of the problem of testing the significance of 
serial correlation coefficients on which a great deal has been written (for references see 
Moran, 1948a). We give here a simple test for correlation between nearest neighbours which 
generalizes a method of a previous paper (Moran, 1948a). 

We suppose that we have mn independent variates-x,, (i = 1,...,m;j = l,...,), and we 
define what seems to be a natural definition of a correlation coefficient between x’s which are 


nearest neighbours. Write = _ Tay and 2%, = 2-3, 
4,3 
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m n—-1 m—-1 n 





prs 65%, frat DD 245%i41,5 
and San a é=1j=1 i=1j=1 
1 \2mn—m—n D2; 
i,j 


- (sama )z. 
2mn —-m—n 
The initial factor is conventionally introduced because there are mn terms in the denom- 
inator and 2mn —m—n in the numerator. In large samples r,, could therefore be considered 
an appropriate estimator of a presumed correlation coefficient between nearest neighbours. 
As we are here only concerned with a test for randemness it is sufficient to consider a test 
using J alone. If the x,; are independently distributed in the same distribution, the z, are 
all on an equal footing, and if their distribution had a finite second moment, the correlation 
between any two z’s would be (mn—1)~*. Without assuming, however, that any moments 


exist, we have m n-1 m-1 n 
DQ Lg gat DD 52415 
E(1) =F i=1j=1 i=1j=1 








D2; 
= (2mn—m—n) Bee 
(orga 


_  2mn—m—n 

~ — mn(mn—1)’ 

because }z,; = 0. (The > symbol without suffixes is used above to indicate summation over 
all values of i and j.) 

To evaluate the second moment of J we have to assume further that all the z,, are dis- 
tributed normally. There is then no real restriction in taking the variance of x,; to be unity. 
The denominator of J is then distributed as x? with mn—1 degrees of freedom, and since 
T is the ratio of a quadratic form in the z,, to a quantity 23, distributed as x? it follows that 
I is itself distributed independently of ¥z?,. We then have for any positive integer p 
E(numerator of J)? 

E(Xzi;)” 
But from the properties of the x? distribution we have 
E(S23;)? = (mn—1) (mn+1). 
We now have to find the expectation of 


E(I?) = 





m n—-l m-ln 2 
(= Pe 24,541 + ~ 243 asus) , 
On multiplying this out we find terms of three different kinds. 
(1) Terms of the form 2?,z?,. The number of such terms is clearly equal to the number of 


joins of nearest neighbours on the lattice, i.e. to (2mn—m—~n). Moreover, by considering 
the characteristic function of the joint distribution of the z’s we see that 


E (2%, 24s) = (1+.2p%) of, 
where p is the correlation coefficient (mn —1)-1 between any two z’s and 


o* = var (z) = (mn—1)/mn. 
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The contribution of terms of this kind to the expectation of the numerator is therefore. 
(2mn —m —n) (1 + 2(mn— 1)-*) o4 
_ (2mn—m—n) (m*n? — 2mn + 3) 
ot. 
(mn — 1)? 
(2) The second type of term is of the form z,,z?,2z,3, and it is easy to see (Moran, 1947, 
p- 323) that the number of such terms occurring in the square of the numerator is 
2{m(n — 2) + n(m — 2) + 4(m— 1) (n—1)} = 4{3mn — 3m — 3n + 2}. 
Moreover, the expectation of such a term is (p + 2p?) o4, and so the total contribution is 
_ 4(3mn — 3m — 3n + 2) (mn — 3) 
o. 
(mn — 1)? 

(3) The third type of term is of the form typified by z,,2,.23323, and corresponds to two 
joins on the lattice without common points. The number of such terms in the expansion of 
the numerator is (Moran, 1947, p. 323) 

4m?n* — 4m2n — 4mn? + m? + n? — 12mn + 13m + 13% — 
and the expectation is 3po*, so that the total contribution is 


= Fpterr= 4m?n — 4mn? + m? + 2? — 12mn + 13m + 13n— 8} 04. 








( 
Adding the above contributions and dividing by (mn-— 1) (mn + 1), we find 
2m3n3 — m3n? — m2n? — 4m2n? + 2m2n + 2mn? — 2mn + 3m? + Bn? 
E(I*) = = 2mn + Smt + Sn 
m*n?(mn — 1) (mn + 1) 





and var J is best found from the formula 
var (I) = E(I*) —[£(2)}. 

Higher moments of the distribution of J could be calculated in the same way using the 
frequencies of various combinations of joins given in Moran (19486), but this would be very 
arduous. If, however, the mean of the distribution of the x’s is known exactly, and r,, and J 
defined using deviations from this mean, the formulae are considerably simpler. In both 
cases it is easy to show that the distribution of J tends to normality as 7 and n increase. 


It should also be noticed that a test, based on rearrangements, for randomness in an array 
of this kind has been given by M. N. Ghosh (1948). 
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ACCIDENT PRONENESS 
By MAJOR GREENWOOD, F.R.S. 


[Editorial note. This paper was probably Major Greenwood’s last completed work. It was 
submitted for publication on the day of his death, 5 October 1949. It is hoped to include some 
account of his life and work in the next issue of Biometrike.]} 


An eminent psychologist has written: ‘When during the last war two statisticians had their 
curiosity aroused by some accident figures in munition works, history was made’ (Smith, 
1943, p. 183). Dr May Smith did not mean that these two statisticians were the first to remark 
that some people had clumsier fingers and (or) less alert brains than others, a fact no doubt 
commented on by the overlookers in manufactories of flint arrows in the old stone age; she 
meant that they were the first (so far as at present known) to propose an arithmetically 
simple test, based on the accident frequency-distribution which would result if those exposed 
to the risk of accident, in an environment which did not change, had some human character- 
istic, later to be christened Accident Proneness, which was a continuous variable adequately 
represented by a Pearsonian curve of type III. Were this true, then the distribution of 
0, 1, 2, etc., accidents would be a negative binomial of the form 


ce \" r r(r+1)  r(r+1)(r+2) 
(3) [estes 31(c+ 1)? +...], (1) 





where r and c can be deduced from the first and second moments of the distribution (Green- 
wood & Yule, 1920). 

This simple test interested psychologists and suggested to them the possibility of detecting 
persons prone to accidents before they had had any accidents. The first thing to do was to 
apply suitable tests to persons who had been or were about to be exposed to the risk of 
accidents, and to learn whether the persons with high (or low) marks in the tests had low 
(or high) accident rates. 

The first results of such an inquiry appeared in 1926 (Farmer & Chambers 1926), and 
several other reports have since been published by the same and other investigators; indeed, 
there is a large ‘literature’ of the subject. I do not propose to epitomize the literature, but 
believe that the following paragraphs fairly estimate what is now established. 

A large number of tests have been tried. Some of these are primarily measures of corporeal 
dexterity, others—at the other end of the scale—explore, mainly, the conative or the 
cognitive sides of human nature or, if the reader prefers, of the psyche. Results show con- 
clusively enough that there is a statistically significant correlation (measured, of course, in 
various ways) between performance in some of the tests and accident scores. We may there- 
fore hold not only that ‘accident proneness’ is a human characteristic, but that it is measur- 
able and that it is reasonable to believe that if persons whose scores in tests found to correlate 
with accident scores in these researches were excluded from occupations involving special 
risk of accidents, the accident rate in such occupations would be reduced. But so far no test, 
or battery of tests, has been found which would exclude the highly accident-prone wit»out 
excluding a considerable proportion of entrants who are not specially ‘bad risks’. 
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This difficulty is not peculiar to the study of accident proneness. It is found in all attempts 
at a priori selection of persons suitable for occupations. But it is a serious difficulty because, 
until it is overcome, it means that we cannot by purely arithmetical methods discover the 
true frequency distribution of the variable we call accident proneness, because we only have 
the distribution of accidents. We can only guess. We know empirically that a very large 
proportion of accident distributions give some of the criteria of a negative binomial, viz. the 
appropriate first and second moments of such a distribution. We know nothing more. 
E. M. Newbold (1927, pp. 504—5) in her classical memoir found in eleven instances that the 
proneness distribution was either in the type VI, or type I; area for ten cases while for one 
case it was in the ‘impossible area’, when the first four moments of the accident distributions 
were used. She justly remarks that, owing to the large probable errors of the higher moments 
and the fact that type ITI is at the dividing line of two areas, all one could say was that 
type III was a reasonable choice. Readers of Bicmetrika do not need to be told that because 
an aggregation of frequency distributions, made by summing the zeroes, the 1’s, the 2’s, etc., 
of the separate distributions, give a negative binomial, the finding is no proof that proneness 
was responsible. We should necessarily reach a negative binomial if the items so aggregated 
were Poissons—unless, of course, they were identical Poissons (Pearson, 1917, p. 139). 
Some beginners have overlooked this. It may, perhaps, be worth noting that if the com- 
ponents aggregated—all 0’s together, all 1’s together, etc.—were Poissons, the variance of 
the resulting negative binomial will be smaller than it would have been if the several com- 
ponents were themselves negative binomials with the same means. 

There is an oddity about equation (1) as practically applied which has not been noticed. 
As the constants of the proneness distribution are deduced from those of the accident dis- 
tribution, they must vary from factory to factory if the external risk varies. But, by hypo- 
thesis, proneness is a character of the individual, a psycho-physiological property which 
exists whether he is subjected to the hazard of accidents or not. This did not affect the use 
of the method made by Greenwood & Yule, who assumed that in each factory the risk was 
constant, but it does make comparison of factory with factory difficult. Suppose then that 
we put the fundamental Poisson in the form 


e*2(1 + ka] 1! + ka? /2! + k323/3!...), (2) 
where k is constant for any one factory or department of a factory, but different for different 
factories or departments. Then our accident distribution will become 


o|(c+ky (1+kr/(c+k) 1! + kr(r + 1)/(c +k)? 2!...). (3) 


At first sight, this is merely trivial; if we write in (2) y = kx, we simply have a straight Poisson 
in y, and if we write ck for c in (3) we are back to (1). But it does make some comparison 
between different sets of data possible and admits of a process akin to the standardization 
of death-rates. Suppose we take an accident distribution, any accident distribution pro- 
vided it is effectively a negative binomial distribution with a mean m, and adopt this as the 
standard form, viz. assume its k to be unity. We take now another accident distribution 
having a different mean m’ which again is a negative binomial. Now put k = m’/m and sub- 
stitute for the c of the standard form c/k = C. We shall have again a negative binomial having 
the required mean. Does this effectively graduate the experience? Trials on some of New- 
bold’s data (Newbold, 1926) showed that this very naive plan did not give bad results, but 
they were not at all convincing because the range of means was narrow. She had, however, 
one pair of observations from the same factory, a manufactory of sweets, where the length 
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of observations was the same for both sets but the means of accidents quite different. The 
sugar boilers had an accident mean of 2-50 and the other constants were c = 0-60902, 
r = 1-52255. The department of chocolate moulding had an accident mean of 3-94, with 
c= 0-36462 and r= 1-4366. Taking the sugar boilers as standard, k for moulders is 1-576, and 
the c should be 0-3864, which is not widely different from its empirical value 0-36462, while 
1-4366 is within sight of 1-52255. Of course this is only what Darwin might have called a 
Tom Fool Experiment, but there may be something in the idea. At least, if the results of 
‘standardization’ are widely discrepant from the observed results, it suggests heterogeneity. 

An obvious cause of heterogeneity is selection. The second column of Table 1 gives the 
observed values of accident frequencies in 166 London Transport bus drivers (first year of 
observation) studied by Farmer & Chambers (1939). The second column gives the expected 


Table 1. Accidents of 166 bus drivers in first year of observation (Farmer & Chambers) 








—, Observed Expected 1 Expected 2 Expected 3 
0 45 40-2 50-3 45-4 
1 36 45-4 41-6 41-7 
2 40 34-2 28-6 31-2 
3 19 21-5 18-2 20-7 
4 12 12-1 ‘ 11-2 12-7 
5 8 6-4 6-7 7-1 
6 or more 6 5°5 9-4 7-2 























Expected 1 is obtained by fitting from the observed mean and variance of the data. P=0-38 for 
4 degrees of freedom. Expected 2 is fitted by ‘standardization’; agreement in total and mean are 
forced. P=0-19 for 5 degrees of freedom. Expected 3 is fitted from the curtailed gamma function 
(the gamma function which is assumed to represent the proneness of the standard population) and 
gives the accident mean of the observed data. P= 0-64 for 5 degrees of freedom. 


numbers when c and r were deduced from the observed mean, 1-81, and variance, 2-91092. 
The c computed by ‘standardization’ on the sugar boilers was half the observed value, 
0-8397 instead of 1-6519, and the observed r twice the ‘invariant’ 1-5225. The observed 
accident variance was 2-91092, but ‘standardization’ required it to be 3-9727. The ‘expected’ 
frequencies, although not so good as those directly calculated, were not bad (third column), 
but evidently the variance is hopelessly large. The results ought to be bad. Bus drivers are 
a highly select population (I shall refer to it when I return from this digression) ; the variability 
in proneness of the exposed to risk must be less than that of the confectionery workers, who 
were certainly not so stringently selected. 

It is quite easy to determine the effects of selection, if proneness is obliging enough to 
have a gamma function distribution, thanks to the existence of Pearson’s J'ables of the 
Incomplete Gamma Function.* Taking the sugar boilers as standard population, the mean 
of the bus drivers is reproduced by a curtailment of about 16% of the frequency. 
Using this, the process just indicated leads to the third set of ‘expected’ accidents which 
is an excellent fit. The arithmetic amused me and may, perhaps, amuse the reader, but 
I do not suggest that it is of much practical value; I have in fact tacitly dropped the notion 


* The terms in (1) were obtained by integration of successive complete I’ functions; these must be 
replaced by the appropriate J(u, p)’s. 
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of a k constant for any one factory department, but changing from department to depart- 
ment. But if we take as standard population any population with a greater mean and 
variance than the population to be standardized, then—provided the accident distribution of 
the latter is fairly well fitted by a negative binomial—we should expect the process to give us 
a fairly good fit. Common sense, however, tells us both selection of workers and differences 
of environmental risk are involved. After all, we know nothing more than the accident distri- 
butions given by samples, and not very large samples, of two populations; too much room 
for guessing remains even for those whose algebra is better than mine. 

Since the publication of Newbold’s memoir, field workers have not bothered about a deter- 
minist approach on these lines and have used Newbold’s stochastic results. To these, with 
certain exceptions to be noted (see p. 28), little has been added; it has, however, been 
pointed out that the algebra would have been simplified by working with factorial instead 
of power moments. 


Newbold defined statistical proneness as meaning that in unit population Sf, = 1, the 
0 


accidents happening to the subfrequency f,, will be distributed by a Poisson law with para- 
meter A,, so that the ‘accident universe’ will be an aggregate of Poissons. What we have 
is a sample of persons from a universe so defined; from such a sample we can stochastically 
estimate the parameters of the ‘universe’. By definition, the best available estimate of the 
mean A is the mean of accidents, A, and it is easy to see that if N (the number exposed to 
risk) is so large that N—1 does not differ appreciably from N, the best estimate of the 
variance of A is the variance of accidents less the mean. In the particular case leading to 
equation (1) this is obvious. The variance of the gamma function is r/c*, that of the accident 
distribution, r/c?+r/c. If A; = A;+¢;, where ¢; is a sampling error and if (, and ¢; are not 


correlated, we have pull O¢ me 2 A ) 
i: ath o%,}° 
‘A ‘A 


If some other variable, x, say the scoring of a person in a test, is correlated with his accident 


score, then ’ 
2A 


These are the relations which have been most used by field workers, whose object has been 
to reach a test, or battery of tests, which correlates highly with A. 

The difficulty of non-comparability of data collected under different environments of 
course remains. For instance, suppose correlations of test scores and accidents vary signi- 
ficantly between different studies. Is that due to selection? Dr Irwin has pointed out to me 
how that question could be answered, if one had rather more adequate numerical data. 
But the variation of what I have called external risk remains. Any statistics of accidents 
must contain a number of events which have no connexion with the personal qualities of the 
exposed to risk. We may safely infer from what we already know that the proportion is not 
large, but it must vary with the occupation. I suppose a minute—and objective—record of 
every accident entered on the statistical statement might enable us to eliminate these, but 
it would be a statistician’s paradise in which such information was available. 

Between 1927 and 1941 no important additions were made to the field-worker’s statistical 
tools, but at least two mathematical statisticians pointed out that a negative binomial 
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distribution of accidents, although a necessary, was not a sufficient condition for the validity 
of the proneness hypothesis (Irwin, 1941, pp. 102—5). For reasons given by Irwin (pp. 106-7; 
see also Greenwood, 1941, pp. 107-8), the alternative hypotheses probably need not be 
entertained when the question is of the kind of industrial accidents which have furnished the 
data used, so far, by all field workers. 

In 1941, Yule showed that if proneness, A, is not increased by increased length of exposure 
to risk, then if we write A, for the mean accident rate over a time of exposure k, then 


24 
KT A ees P ° i 3 : ‘ 
= Ar is invariant with respect to time of exposure; then ,r,, is given by 


KT 4 
KYA = KAA - he 
k 


Chambers, however, found from the data of bus drivers that ,v, decreased with length of 
exposure, i.e. is changed by experience. For bus drivers in the first year ,v, was 0-578, in 
the fifth year 0-444. 

On the practical side much has been done in the last 20 years, especially by Farmer & 
Chambers. In their first report (1926) the subjects were girls employed in covering or packing 
sweets, dockyard and R.A.F. apprentices; in their last report (1939) bus drivers in the 
London area. These reports have certainly verified the existence of accident proneness and 
proved that this quality is correlated with the scoring of certain sensori-motor tests. One 
may conclude, as Irwin put it (1941, p. 107): ‘(1) That, apart from differences between drivers, 
accidents are certainly occurring at random. (2) The absence of a significant difference from 
year to year rules out the hypothesis of increasing liability to accident due to previous 
accidents.’ The reader will remark that the first report held out more encouragement to 
job selectors than the last. The conclusion was reached then that ‘the final weighted results 
show a difference of 48 % in accident rate between those above and those below the average 
in the tests’ (Farmer & Chambers, 1926, p. 36). The study of bus drivers led to the following 
conclusions (Farmer & Chambers, 1939, p. 36). If the worst quartile of testees had been elimi- 
nated the subsequent accident rate on the retained would be 7 % less than it actually was for 
the total. If not only the worst quartile, but any other drivers who had three or more 
accidents in the first year were eliminated, a reduction of 44 % of the exposed to risk, the 
improvement would have been 13%. There is, of course, no inconsistency between the 
results. Dockyard apprentices and employees of a wholesale confectioner do not have to 
pass the rigorous tests endured by would-be bus drivers. The eliminating tests are unlike 
those of the field psychologists, but they may well overlap them. Farmer & Chambers give 
the test scores of 128 of the 166 bus drivers. I find that the thirty-eight drivers who were not 
tested did not have accident scores significantly different from those of the 128, so we may 
regard the latter as fairly representative. 

I make the correlation between accident score and test score for the first and fifth years 
0-12 in each case; neither is ‘significant’ by itself, but, even assuming that there is really 
a positive correlation, its order of magnitude is too small to have much practical value if 
the regression is linear. Naturally what the field workers would like would be an unselected 
population of future motor-car drivers, ail of whom are tested and all of whom are obliged 
to report every accident, however trivial. Outside a police state such a statisticians’ paradise 
is a dream—or nightmare. 
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ORGANIC CORRELATION AND ALLOMETRY 


By K. A. KERMACK anp J. B. 8S. HALDANE, University College, London 


In studies on organic correlation it is frequently desired to fit a straight line to show the 
general trend of the relationship between two variates. The residual scatter of the observed 
points about any such line is often due mainly to the biological variability of the material; 
and the errors of measurement may only account for a very small part of it. For such a case 
the conventionally used regression lines are quite unsuitable, since here the terms ‘dependent 
variate’ and ‘independent variate’ have no real meaning. It would perhaps be more reason- 
able in our case to follow Karl Pearson (1901) and choose the line which minimizes, not the 
sum of the squares of the deviations of one of the variates as do the regression lines, but 
rather the sum of squares of the normal deviations of the observed points. This line is the 
major axis of the correlation surface, making an angle 0 with the x axis, where 





tan 20 = a. ‘ (1A) 
29 — oz 
tend a = (20 — Ho2) + Tah + (M29 — Ho2)*) (1B) 
11 


and was first suggested by Adcock (1878) from the rather different point of view of finding 
the best line when the errors of measurement of both variates are equal. For us it suffers 
from the disadvantage that, while invariant under rotation of the axes, it is not invariant 
under change of scale. In practice it is the latter that is important, invariance under rotation 
being normally of negligible advantage. As suggested by Jones (1937) and Teissier (1948), 
a line invariant under change of scale may be obtained by considering the major axis of the 
distribution of two variates expressed in standard measure. Then, since in this measure 
Loo = oo = 1 by definition, tan @ is also identically equal to unity, irrespective of the value 
of /,. 
Therefore, the equation to the line in terms of the original variables is 








Y-Y_ «-% 
a 
«oe 7 — luz 2 
and so y sta +(9 73). (2) 


This line may be called the reduced major axis. It may be seen that, not only is it invariant 
under change of scale, but, in addition, its computation involves only the sums and the sums 
of squares of the two variates, the computation of the sum of products not being involved. 
A further advantage will be seen by a consideration of the standard error of the estimate of 
o,/o,, in equation (2) compared with the standard error of the estimate of tan #, which is 
involved if the major axis is fitted. These may all be obtained up to the order of n=! by 
straightforward methods, as below. 


As in equation (1), but considering here the sample, with 7' the estimate of 0, we have 


tan 27 = ma, 
Meg — Mog 
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Now consider the standard error; we proceed as follows: 


d(tan 27’) _ Om, _ Ory. OMo2 


tan20 fy, Mao— Hon Mao — Mon 
Squaring and summing gives 





4 (40 + Hoa — 222) (M13 — #31) 
var (tan 27) = — +], +2 ae (3) 
( ) 2 foo — M2)" Pas Pi (29 — Ho2)" L209 — o2 


T = Hye( Hoo — Hox)” + 9, (Hao + Hoa — 2Ma2) + 2fty3(H13 — M31) (20 — o2) 


+ 2py 























so that var (4) 
[(H29— Mon) + 4093)" 
areal 4ui, | ( 4uiy )} 
andso  var(tan7’) = +1+ /{i+ ——-}| varT’. (5) 
ha { 4uihy (20 — Ho2)” (M20 — Hoa)” 
/ (: +e | takes the negative sign if tan 20 is positive. 
(#20 — Hoa) 
In the normal case (3), (4) and (5) reduce to 
var (tan 27') = (1 — p?) (1+ tan? 20) tan? 20 (6) 
n > 
(1—p?*) sin? 20 
Pe eR all: +a ea 7 
var T' 4° ’ ( ) 
— 
and var (tan 7') = (Sods 54 4 (8) 
np 
1—p*\ttan 0 
Cua 2 = ( iF) ae (9) 


Equation (8) in certain cases takes simpler forms. If p = 0 


o2— 02 
var (tan 7') = —%_4.., if o2>o2 
2 2\2? z y 
n(o7Z— 4) 
pom 2 
= 00, if o2<o%, 
: ... on 
and if Oz = Oy, 
_ 
var (tan 7’) = —— ; 
np 


similarly obtained: 8(IMpq/IMyq) _ SiMog _StMyq 


Loa! 20 Hoe Leo 
“dl Hie (Ax os _ 2Mee 
No \H30 Hoe Heo/oz 
f 2 
and var(22) ~ fm (Fr tee ee), (10) 
‘83, 4Nfoy\H2o Moz Heo/toz 
In the normal case, equation (10) becomes 


2(] —o2 
var (24) = 2y°=F 2. (11) 
8, os: n 


, m 
Squaring and summing var (==) 
Meo 


Equation (11) is identical with that obtained for the variance of the regression coefficient 
in a bivariate normal population—a rather surprising result, due to Teissier (1948). 
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Table 1 gives the efficiency of tan 7’ in terms of s,/s,, as a percentage, in a number of cases. 
It can be seen from this that the use of the statistic derived from the major axis, rather than 
the other, always leads to a loss of efficiency, which can, if 2 and o? are nearly equal, and 
the coefficient of correlation small, be enormous. 


Table 1. Comparison of the accuracy with which the slopes of the reduced major 
axis and the major axis can be estimated 








var (8,/s,) 
var (8y/8,) x 100. 
var (tan 7’) 
o,/T. 
0 0-1 0-4 0-7 1-0 
p 
0-0 100-0 98-0 70-6 26-0 0-0 
0-1 100-0 98-0 70-9 27-0 1-0 
0-5 100-0 98-5 78-4 47°3 25-0 
0-9 100-0 99-6 94-7 87-4 81-0 
1-0 100-0 100-0 100-0 100-0 100-0 


























The exact distribution of the ratio s,/s, is known in the bivariate normal case, and is 
given by Bose (1935). It is 





Tahar otf, pat 
vor (“3 at) eter “(i+eyf ” (12) 
B—_, — 
2 2 
where w = *¥2z, Finney (1938) should be consulted for practical details as to the use of 


8,0 


this distribution. The distribution of tan 7’ is unknown. 
The sampling variance of 7 —-Ztan 7' may be obtained as below. For a normal population 


6(7 —Ztan 7’) = dy —tan0d%—p,,dtanT, 
2 
80 var (¥—ZtanT') = =| (v-aetand?+ (1 —p) tan (20,0, + Metenet +e) |. (13) 


The sampling variance of (7 —%s,/s,) may also be easily obtained as below: 
oy xi %8,/8,) ae 7] — 8% o,/o, —Fr0 8(8,/8,), 
so, for a normal population, 
— o $(1+ 
var (yj —%8,/8,) = 7 (1—p) (2 + fl re) 


$2), 0 


a very simple result. 
ALLOMETRIC CORRELATION* 


In many cases of organic correlation it is found that the distribution of the variates is hetero- 
scedastic and skew. Often, however, the distribution of the logarithms is homoscedastic and 
more nearly normal. Hemmingsen (1934) discusses this point at some length, and gives many 
examples. In addition, it may be found that the fitted straight line does not pass through the 

* In the following sections of the paper it has not always been possible to distinguish between the 
population parameters and their estimates obtained from the sample, by the use, in the usual way, of 


two separate sets of symbols. It is not anticipated, however, that any great inconvenience will thereby 
be caused to the reader, the meaning of the symbol being obvious in each case. 
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origin. This may be due to a significant curvature in the trend of the two variates, and it 
may be more useful to fit a line of the form y = f2* (allometric growth of Huxley (1932)). 
In almost all cases where this has been done in the past, one of the regression lines has been 
fitted to the logarithms of the data. For the reasons given above, it is suggested that con- 
siderable advantages are obtained in many cases if the reduced major axis of the logarithms 
is taken. This may be done in a very simple way if the distribution of the logarithms can be 
assumed to be normal. 

The numerical examples given below will show that the accuracy of the results obtained 
is not very sensitive to deviations from normality. 

Let x = eX, y = e”, where X and Y are normally correlated; and let v, = 7 ,/% and v, = 0,/9, 
in other words let 100v, and 100v, be the coefficients of variation. Then if 


exp [Xt+ 40% ¢?] = M(t) = moment generating function of z, 


a =eX = M(r), 





and so = = exp[X + 40%], (15) 
Feuer ]. (16) 
Thus exp[o%] = 1422 
and o% = log(1+v3), (17) 
Thus we see that oF = log(1 +04). (18) 
2 
= = [ean | = (19) 


if we take « as the slope of the reduced major axis of the X, Y distribution. As (19) is the 
ratio of two logarithms, either natural or decimal logarithms may be used in computation. 
It may readily be seen that the accuracy of equation (19) will not be very sensitive to a 
moderate deviation from normality of the distribution of the logarithms. 
Let €=7=0, C2 =1+ , 9? =1-p, and let x,,x,,... be the other cumulants of the 
distribution of ¢, «3, x4, ... those of 7. Let € and 7 be independent. Now let 


o 
Y = am +log B+ (6—"). 
Then var X =o, varY = a?o? 


and S(X —X)(Y—Y) = apo’. 


So X and Y have correlation p, regardless of the higher cumulants of € and 7. Then the 
cumulant generating function of X is 


rT 


K x(t) = mt + 407? + ‘8 S"() (kK, +e), 


r ~ y 
oe ane F Ky(t) = (am+log f)t+ 4a*o*t? + "Ss “( 4) (k,—Ky) 5, 
r=3\~V rt 
and let a=eX, y=eF 
Then as before gw =eX =e) 
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so that ¥= exp[m+otlexp| 'S (5) K,+K;) =|: 
and x? = exp[2m+ 20%}exp| "S| (/2o0)" (kK, +k;) “|: 
Clearly, then 2 a 
1+v2 exp| o*+ "8 8 (S4")2 -N 5553 
and ee ‘8 (= ale say pS 
Similar! log (1+ v2) = a%o?+ "s ts (27-1 1)- nn 
a i r=a\ vay” 





log(1+02) — 





lo og(1+v5) _ a2 (~—1)K,—(a+1)ks o 2 2 , 
1+ 2/2 o+ Faia —1)ky—7(a? +1) kK, 


giving 
— 6(a — 1) Kg(Ks + Kg) + 6(a + 1) K3(K3+K3)}+ ep 


Putting Ky=(1+p)iy;, Ky=(1+p)?¥e, Ke=(1—p)iyi, Ka = (1—p)? Ys, 
and so on, we have 

log (1+) _ af y 4 (2-1) (1 +0) —(% +1) (1-p) Yi | 

log (1 + v2) 2/2 


+ (at 1) (1+ p)*y74— a+ 1) (1p)? %4— 8-1) (1+ p74 





+ 6(a+1)(1—p)y/2-+ 12(1-p)'y,73} + (0%) |, 


Supposing 7,, V2, V1, V2, etc., to be quantities of the order of unity, the first term of the 
correction factor is small with («—1)o¢ or (1—p)*o. o is approximately the coefficient of 
variation, and will rarely exceed 0-2, while a—1 and 1-—p are generally of the order of 0-1 
or 0-2. Thus a? will rarely be out by more than a factor of 4 % or a by a factor of more than 
2%. The most serious errors are likely to occur when a is fairly large, and p small. 

In addition, we see from equation (19) that if two variates with normally correlated 
logarithms have different coefficients of variation, then either the axis is curved (i.e. « +1) 
and allometry must be suspected, or it does not pass through the origin. In biology there 
are a number of examples of the latter, amongst organs which do not appear until the animal 
has reached a certain minimum size, antler length in male deer being a case in point. In most 
cases, however, for two organs, both present in the embryo, the axis must pass through the 
origin. 

Further, from (15) and (16), it can be seen that 


eX = %(1+2)-+ 


and X = logz—}log(1+03), (20) 
Y= i ih ol (21) 
Thus yp [rp , J -[ecn? 2 


(22) giving our estimate of log £ by the insertion y the sample values. It should be noted 
that while m; and m, are unbiased estimates of yj and 12, log (1 + m,/m;?) is not an unbiased 
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estimate of log (1 + 2/3), nor is log m; — $ log (1+ m,/m4*) of iog uj — } log (1+ 4/442). The 
unbiased estimates have been derived in a separate paper*. They are, to an order n-!, 


t n 4m2 
log (1 +) = log(1 +ms)- = 




















¥ mm") nm,!’ 
, 13 =a ’ Ms m 
and log; — Hog (1-+ 4%) = logm; — Jog (1+ 2) —m.. 
The correction to « is therefore 
(“2 (1 Holl! a ( (1+ ve) (1 _ 2moe (a? — 0) 
log (1 + Ho2/ #0) log (1 + mgq/mo') mot 


It can be seen that all corrections are normally quite negligible. The transformation of a 
grouped variate will introduce further bias, which again will be usually negligible. The 
reference quoted should be consulted for further details if required. These corrections have 
not been employed in computing the examples given in the present paper. 

The sampling variances of the estimates obtained from (19) and (22) can be obtained by 
substitution of the sample values in equations (11) and (14) above. The variance of 
exp (Y —X sy/sx), the estimate of 8, may then be obtained at once by remembering that 


var (e*) = e* vara. (23) 


The exact distribution given in equation (12) may also be employed. It is clear that in any 
case the allometry is significant if « is significantly different from unity. The method given 
by Finney (1938) is useful for testing in this case. Similarly, the coefficient of correlation p 
of X and Y may be obtained in terms of the correlation coefficient p’ of x and y, 


ay = exp[X+ ¥] 
= exp[X+ ¥+4(o%+ 04+ 2poxcy)} 
= %¥exp {p[log (1 + v2) log (1 + v2)]*}. 
log (1+ p’v,v,) 





Therefore P = Tog (1 + 08) log (1+ Te (24) 

And since My = PT xAy = log(1 +p'v, vy), (25) 

the regression equations of the logarithmic data may be obtained by substitution in the 

well-known formula ~~ mer (i c pal 
Fo2 Foe 


Similarly, the major axis of the logarithmic data may be obtained if desired from equation 
(1), and the variance of tan 7' from equation (8). 
The sampling variances of equation (26) may be obtained by substitution of the sample 


values in the well-known results ™ (1—p?) 
var (=) otwe ee (27) 
Moe} on 
_ My, z) H20 2 40 
var |y—-—"z} =—"(1- iy (14).. “ 
(7 Mos n . foe ” 


* It is hoped to publish this paper shortly in Biometrika. 
3-2 
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A SHORTER METHOD 


If v, and v, become small, so that v? and higher terms of v may be neglected, then from 
equation (19) 


a= = —, (29) 
ox Uz 
while in the same way poz =p’ “2. (30) 


These results may be obtained in another way. 

If the correlation between the two variates be high and positive, and their relation 
approximately linear, then the appropriate straight line may be taken as a tangent to the 
allometry curve at the means of the variates. Then since 


y = Ba", 
ant ed == a Batt 
% dy 
a= 7 dx" 
Thus for the reduced major axis ZO, Vy 
a= —— = =, 
Yo, Vz 
as in equation (29). For the regression lines 
zo v 
g== ‘Y=’ , 
9” Zz p Vz 


as in equation (30). 
This method does not apply to the major axis, since 


_ (Y=) + vido 05 + (02 — 9") , 2 {— (C—O) + Vi4pPoxoy + (0k— FP} 





2v,v,p" y 26x7rp 
and the use of the short method is not recommended in this case. In all cases 
log 8 = logy—alogz. (31) 


The sampling variance of the estimates of 


Yy a %) 2 _ pr ie tn 
i logy 9, 08% Pd and logy ta var 


zx 

may be obtained quite simply as below. For the reduced major axis 

3(v2 /v2) _ My _ SIM, 20M " 26m, 

05/05 Me «8M = My Moy 
Squaring and summing for a normal et population 

v. lv ’ , 
var (?2) = ok (L—p™ 08+ 05-2 p'V,Vy), (32) 
While a(logy— ——“log z) = =| 89(1 + iS log z) — 6%(1+ log z) “4 - a() % log z| ; 
so that ? 2 F 
var (Iog j- oY oe z) 





= ne (1 -ze); +(1- p'{2 (1+logz) (1+ Plog) + (1+) ee *\|. (33) 


For 


and, 


Fur 





2) 


3) 
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, , d(p’ v,/v 6m,, OM Sm, dm} 
For the regression lines 8(p'ry/%2) = — _ 3 5 a 0 
p’ v, |v, M1, = Mon ™qy My 


and, squaring and summing, as before, for a normal population 


var (o" cu) = ce vey p'*(1 — v3 — v3 + 2p’v,0,)]. (34) 
z= 


Further, we see that 


a(log 7 -p' og) = =| su(1+ “log 2) - sup’ ———. a(o a log |; 
: x Vz 


squaring and summing 


v2 
var (log7- p’ “Hog =" a p) (14% s gS + 20" Hog) + p(1+22 (1- 20')) |. (35) 
In all cases, as in equation (23), varb = b* var (logb). 


It can be seen that equations (32), (33), (34) and (35) only reduce to those obtained in the 
exact case under the following conditions: the coefficients of variation should be negligible 
compared to unity and subequal, and, for equations (33) and (35), the coefficient of correla- 
tion should be large and positive. Under any other conditions the short method may give 
misleading results. 

Below, in Appendices, are given an Example and a summary of the main formulae 
developed. 


APPENDICES 


I. Illustrative example 


An example will be given. It will be taken from a population of 338 specimens of Micraster 
cor-anguinum from the chalk of Northfleet, Kent. On these specimens the total length (/), 
and the height to the apical system () were measured. Table 2 gives these results arranged 
as a correlation table. From an examination of this table it may at once be seen that the 
distribution is both negatively skew and heteroscedastic, while the trend of the observations 
shows a slight but distinct curvature. From Table 3 it can be seen that the correlation be- 
tween the two variates is high (0-8848), and that the fitted straight lines do not pass through 
the origin. Table 4 shows the data replotted as natural logarithms; the distribution now seems 
to be reasonably homoscedastic, although the negative skewness is, of course, increased. 
Table 5 gives certain relevant parameters for this distribution. In Table 6 the parameters 


Table 3. Micraster cor-anguinum. Parent population 

















Apical height (h) Total length (i) 
Mean (h) = 30-903 mm. Mean (I) = 50-078 mm. 
Variance (s?) = 21-93 sq.mm. Variance (s?) = 92-87 sq.mm, 
Coefficient of variation ’ Coefficient of variation 
x O0-O1(v,) = 0-1515 x0-01(v,) = 0-1924 





Coefficient of correlation (7) = 0-8848 + 0.0118 
8,/8, = 0-4860+0-0123, h—(s,/s,)1 = 6-567 + 0-623 mm., 
1(8,/8;) = 0-4300+0-0123, h—r(s,/s,) 1 = 9-370 + 0-632 mm., 
tan T = 0-4494+0-0129, h--tan Tl = 8-398+ 0-656 mm. 
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Table 2. Micraster cor-anguinum. Table of length x apical height 
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Table 4. Micraster cor-anguinum. Correlation table formed of 
natural logarithms of apical height (H) and length (L) 






















































































| 
L 
3°25 | 3:35 | 3-45 | 3-55 | 3-65 | 3-75 | 3-85 | 3-95 | 4:05 | 4:15 | 425 | Total 
H 
\. 
3-75 ee ee ee en eee eee eee ee ee Bk ree 1 
3-65 — — — — ~- -- —- 2 10 14 2 28 
3-55 _ _ — -— -— oa 3 23 46 22 1 95 
3-45 —_ — —_ — — 3 25 37 21 2 —_ 88 
3-35 — — — 1 8 16 19 12 2 1 — 59 
3-25 -- os — 10 11 7 3 1 1 — — 33 
3-15 — 1 2 7 3 1 1 — _ — —_ 15 
3-05 —- 3 6 — — — — — — —_ — 9 
2-95 2 2 3 — — — — — — —_ — 7 
2-85 wa ee OA ee en oe en oe Se 1 
2-75 ee es ee ee ee ee ee ee 2 
Total a 6 12 18 22 27 51 75 80 40 3 338 
i 
Table 5. Logarithm population 
| Logs of apical heights (H) Logs of total length (L) 
| Mean (#) = 3-4183 Mean (LZ) = 3-8914 
Variance (s%) = 0-02852 Variance (s?) = 0-04475 
Coefficient of correlation (r) = 0-8865 + 0-0116. 
Table 6. Micraster cor-anguinum. h = 6l* 
Method a b 
Regression of log h on log / (calculated from iogarithmic data) 0-708 + 0-020 1-94 + 0-15 
Regression of log h on log J (assuming normally distributed logs) 0-701 + 0-020 1-98 + 0-15 
Regression of log h on log / (short method) 0-697 + 0-020 2-02 + 0-16 
Regression of log / on log h (calculated from logarithmic data) 0-901 + 0-026 0-918 
Regression of log J on log h (assurning normally distributed logs) 0-891 + 0-025 0-944 
Regression of log / on log h (short method) 0-890 + 0-026 0-950 
Major axis (calculated from logarithmic data) 0-776 + 0-022 1-49+0-13 
Major axis (assuming normally distributed logs) 0-767 + 0-022 1-54+ 0-13 
Reduced major axis (calculated from logarithmic data) 0-798 + 0-020 1-37+0-11 
Reduced major axis (assuming normally distributed logs) 0-790 + 0-020 1-41+0-11 
Reduced major axis (short method) 0-788 + 0-020 1-42+0-12 














of the equation of allometry (y = fx*) have been computed in three ways: from the log- 
arithmic data of Table 4; from Table 2, in the one case on, the assumption that the distribution 
of the logarithms is normal, and in the other assuming that the fitted straight line and the 
appropriate allometric curve are tangential at the means (short method). Results are given 
for the two regression lines, for the major axis, and for the reduced major axis. It can be 
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seen that the agreement between the results obtained by the three different methods is very 
close, the results obtained by assuming the logarithms to be normally distributed being 
consistently better than those obtained by the short method. The marked negative skewness 
of the logarithmic distribution seems to have had singularly little effect on the accuracy of 
the results obtained by the method assuming normality. In addition, the value obtained 
for the coefficient of correlation by the latter method (0-8866 + 0-0116) should be compared 
with that obtained directly from the logarithmic data (0-8865 + 0-0116). 

Incidentally these results show the very considerable disadvantage of using regression 
to calculate allometry. The value of « calculated from the regression of h on/ is 0-71, from the 
regression of / on h 0-90, whereas 0-80 is a more satisfactory value. 


II. Summary of formulae 
1. Fitting a straight line, y = ax+b. 
(1:1) Major axis: 


82” 


b= patents |\* (s, —s, tan 7’) + (1—r’) tan | 25,8, , Ztan M(1+ +r} 


r2 | ; 


2. 
a= tan (1+, | a): tan 2 = Sey 








(1-2) Reduced major axis: 





(1-3) Regression line: 





b=7- wean, [2% +2). 


2. Fitting allometry curve, y = bx, assuming normally distributed logarithms. 
(2-1) Major axis: 
eo 


—r ; 2 log (1+ v,v,1') 
ne eons - ae 
a tan 7"( toy = ), tan 27” = log (1 + v2) —log (14+ 08)’ 


b = exp {log 7 — $ log (1 + v2) — [log % — } log (1+ v?)] tan 7”} 





1 a 
x (1 + Jt | dost a + v?) — log? (1+ v2) tan 7”)? + (1 —r)tan "| 2 loge (i + v2) log# (1 + v2) 





, [log # — } log (1+ v3)] tan "(1 *aN))). 


r2 
log (1 + v}) - 1-r? 
cere tt Ya): 


b = exp {log 9 — } log (1 + v2) — a[log %— } log (1 + v2)]} 


(2-2) Reduced major axis: 


x(1+0 /[C= C=) (210g (1+ 08) + (1 +r) [log x + flog ( a+enp). 
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(2-3) Regression line: 
log (1+r’v, as [cet e) 
te log(1+v2) ~A \log(1+v2) an ; 


b= war eee ee 1 + v2)}}) 


{ (1— (log % — 4 log (1 + v2)) 
dis ff eac nostic) 


(2-4) Coefficient of correlation: 








i log (1+1’v,vy) 
~ aj/[log (1 + v2) log (1 + v?)]” 





3. Short method. 
(3-2) Reduced major axis: 


Vy 1-r? +3 + 05-2 2r'v, Vy 
a= — 1+ n ? 


b = (exp {log ¥~—a log Z}) 


«(122% [flog x1 -%)'- a=r)| 2 (1+logay(1+° tlogz) + C+ 08 I). 


(3-3) Regression line: 


v l—r?-—1+v2+42 ah: ’ 
a=r'u(is [3 r’ + Uz t Vy- ete), 
Uz n 


b = (exp logy—aloga})| 10, /{°—7] 14 "8 + 2r’- Cvlogz+r'( 14% ¥(l— 2’) }}]. 
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THE PROBABILITY INTEGRAL TRANSFORMATION WHEN THE 
VARIABLE IS DISCONTINUOUS 


By F. N. DAVID anv N. L. JOHNSON 


1. It is well known that given a continuous random variable, x, distributed with elemen- 
tary probability law, p(x), then the random variable 


is distributed rectangularly in the interval [0, 1]. This is, however, only true for a continuous 
random variable x with known probability law. In a previous publication (1948) we have 
discussed the effect on the distribution of y if the parameters of the distribution of x are not 
known and have to be estimated from a random sample of n observations. In the present 
paper we discuss the moments of the distribution of the transformed variable y when z is 
discontinuous, first when the probability law of z is known and second when parameters of 
this law have to be estimated from observed data. In both these cases, if p(x) be the elemen- 
tary probability law of the discontinuous random variable, xz, the transformed variable, 
which we shall call v, where 


v= Ep), 


will not be rectangularly distributed. The first of these cases has already been the subject 
of an arithmetical investigation by H. O. Lancaster (1949). Lancaster suggested a modifica- 
tion of Fisher’s x? test for the combination of tests of significance which has as its basis the 
assumption of rectangularity. This present investigation is carried out from a purely theo- 
retical standpoint and in so far as the topics discussed here are common with those of 
Lancaster’s paper, his empirical suggestions are confirmed. 

2. We consider a random variable x which may take any one of a finite set of k mutually 
exclusive values, which are also the only possible, with probabilities p,, po. ...,p,, where 


k 
LP; = 1. 
j=1 


The transformed variable, v, may therefore take any one of a set of values p,, p,; +o, ..., 


Pi +P_t...+p,, with corresponding probabilities p,, po, ..., p,. From elementary consider- 
ations we have ac a k k 1 k 
E(v) = LP; UY; = Ep er P,) - 3(! +321). 
#=1 j=l {=1 j=i+1 i=1 
The algebraic form of this expression suggests that we might redefine the variable, v. Thus 
instead of writing v as above we shall consider the variable u, where wu is defined as 
i-1 
U; = Dit ip, (¢= 1,2,...,&), 


and as before Plu=uj=p, (¢=1,2,...,k). 


— 
We have then &(u) = > pi( x s+ 4p) = ~- 
ini oul 


a 





len- 


‘hus 
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The new variable, w, has thus the same expectation as in the continuous case. The second 
and higher moments follow from an application of elementary expectation technique. 


Thus k  /t-1 r 
E(u’) = UP: (= p,+ 42.) (r = 1,2,3,...), 


from which it is easy to deduce that 


a 9 eo 
(uw) = Z(1- Zat+ 5.2mt+dy & ; Pips): 
4 i=1 25-1 i=1j=i+ 


but) =1(1— © $994 2} tS sass Ss 
(wt) = E(1-F Dott Ss Sot 75 Vvt+oy S vty FE pies 
j= 
5k-1 ‘ k—-2 k-1 
73 S pipi- eT > Pipsp.). 
i=1j=i+1 i= = i+1s=j+1 


Correcting to moments about the mean we have 


fa(U) = OF = = 5(1- B24), 


i=1 


k k-1 k \ 


1 k 
H3(u) = 3(- Tpit Vwi+e 25 > Pips), 
t= = i=1j=i 


1 1 & _ ll * k-2 k-1 1*- 
py(u) = 8078 x Pi- 3, > pi- 9 a > Pip; >» >» y PiPiPo— 52 , Pi D3. 
8i=1 i=1 2i=1j= =i+ i=1j=i+1s=j+1 24=1 j=i+l1 


It is clear that as k, the number of groups, increases without limit, the moments of u tend to 
those of a random variable, rectangularly distributed, which is to be expected. 

3. The moments of v may be obtained directly in similar fashion, or may be deduced from 
those of u. We give the first three of these for the sake of completeness, but have omitted the 
fourth because of its complexity. Thus 


ow) = 5 (14 Eat), 


k k-1 
E(v*) = (14222843 2, a pit), 
i=1j=i 
3 k 3/k 2 k-1 
—3,2P f+3 Yot- 3 Sots GE ) +32 = PiPj 
2i=1 gang 2i=1 4\ 5-4 i=1j= 


k-1 k-2 k-1 
—Z E peph+ 3 x y PiP;Ps» 


, i=1lj=i+1 i=1j=i+1s=j+1 
from which we deduce that 


k 1(/k .\2 kl k 
oMe) = Tt gE e—5 Eot- (Dot) + ES perh 
k-1 k 


pao) = 2B vh+2 E ot-3( ¥ vt 5 Eel) +55 Spat a PiPi 


4i=1j=i+1 i=1j=i+ 


+35, S z PEP; Pet i( 3) -(327)(3 z 2) (3 z ot) ( = s pit). 


d=1j=i+1s=j+1 i=1j=i+1 
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4. The moments deduced for u aad v above are quite general and will hold for any discrete 
probability distribution. The two discrete distributions in which we are most likely to be 
interested, however, are the binomial and Poisson’s limit to the binomial. We have therefore 
investigated for these two distributions the departure from rectangularity of the distribu- 
tion of w as measured by the moment ratios ,/f, and f,. The results of these numerical 
investigations are given in Tables 1 and 2 and are shown graphically in Fig. 1. 


Table 1. ./f, and £, of the distribution of the transformed variable u 
when the original variable has distribution function (q +p)” 











p 0-5 0-6 0-7 0-8 0-9 

n —Jp, | A, —Vp, be —WVA, bs —VA, Bs —VAi Bs 

2 0 2-000 0-029 1-802 0-213 1-458 0-655 1-561 1-590 3-547 
| 4 0 1-831 0-018 1-841 0-044 1-865 0-143 1-655 0-740 1-692 
10 0 1-824 0-004 1-824 0-010 1-826 0-060 1-789 | 0-097 1-892 



































Table 2. 6, and £, of the distribution of the transformed variable u when the 
original variable has a Poisson distribution with parameter m 





m 0-2 0-5 0-8 1-0 1-2 1-5 1-7 2-0 





VB, 1-669 0-586 0-232 0-135 0-087 0-054 0-043 0-033 
Bz 3-818 1-581 1-587 1-697 1-769 1-810 1-816 1-817 



































We may note that as n->0o and p->1 but n(1—p) = m, the ./f, and £, of the binomial 

distribution tends to the values corresponding to the Poisson distribution with parameter m. If 
p be fixed then, as n + 00, each term (except the constants) in the expressions for the moments 
of u and v will tend separately to zero, and we are left with the moments of the rectangular 
distribution as might be expected. Fig. 1 shows that the assumption of rectangularity for 
u may be very misleading, particularly when the asymmetry of the distribution of the original 
variable is marked. It will be seen from a study of the algebraic expressions for the moments 
of u that the minimum departure from the rectangle moments will be when all the p,’s are 
equal, the maximum departure when all but one of the p,’s are zero. 
5. R. A. Fisher’s application of y? to the probability integral transformation consists in 
noticing that —2log,w is distributed as x? with two degrees of freedom, provided u is a 
continuous variable. Thus if we have r independent continuous variables u,, ug, ..., u,, it 
will follow, owing to the additive property of x?, that 


e 
—2 > log, u,; 
i=1 
is distributed as x? with 2r degrees of freedom. The moments of the distribution of a single 
discontinuous variable, —log,u, may easily be found. For brevity we write 


k 
and we have &(—log,u)? = (—1)° > p,{log, (1 — ¥;— 4p,)]’. 
i=1 
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Using the linear difference operator EZ we may write 


k 
& (log, u) = Y p, Hi [log, (1 — ¥;)), 
i=l 
or, since HE=1+A=eD, 


(log, u)? = Spel” [log (1~YyP = 3p. PP” hog, (1 Yo. 
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This, on substitution and rearrangement, becomes 


2» 1 ]\w-1 k b 
&(log,u)? = z a—ails) ary ; fy = log, (1 - : z Ps) | A 
- = (> Ps) 





This result may be reached alternatively by makina &(log,u) by the binomial and sum- 
ming along diagonals. The algebraic expressions for moments do not seem capable of expres- 
sion in any simpler form. From the expression for &(log,u)° it is possible to deduce the 
cumulants of the distribution, and hence, making use of the additive property of cumulants 
of independent random variables, to write down the cumulants of the distribution of the 
sum of r independent discontinuous random variables w,, Ug, ..., U,- 

6. We now proceed to show that as k, the number of groups, increases without limit, the 
moments of — 2log,u tend to those of x? with two degrees of freedom provided each of the 
p, are different from zero. We have 


k k b 
lim &(log,u)’ = lim DP; | }ou( - > D- ii) | . 
‘ud j=i+1 


k>o k>o 
pi->0 pio 
(t=1, 2, ..., &) . (i=1, 2, ...,k) 
i 
Write Pr =Z, and p,=AdZ,; 


k 
then & (log, u)’ = 5 AZ, [log (Z;,—4AZ;))° 
i=1 
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It is clear that we may ignore the 4AZ,; inside the logarithm, since on expansion this will 
give rise to second-order terms in AZ; which will be negligible in the limit. We take then 


k 1 
lim @(log,u)? = lim > AZ,{log, Z;]° -| (log, Z)°dZ. 


ko k>o i=1 0 
AZ;->0 AZ;>0 
Write Z=e-, 
whence lim &(log,u)® = (— 1» z>e-*dz = (—1)°5!, 
iat 
and therefore lim &(—2log,u)? = 2°b!, 
AZe>0 


which is the bth moment about the origin of the distribution of y? with two degrees of freedom. 


Table 3. Actual tail areas of the probability distributions of u and v for the binomial 
(q+ p)" corresponding to 0-05 and 0-01 levels in the continuous case 

















n Pp 0-5 0-6 0-7 0-8 0-9 
2 - u 0 0 0-09 0-04 0-01 
Xo-08 {\o 0 0 0 0-04 0-01 
u 0 0 0 0 0-01 
Xo-or % 0 0 0 0 0-01 
4 . iu 0-0625 0-0256 . 0:0837 0-0272 0-0523 
Xoos iy 0 0-0256 0-0081 0-0272 0-0037 
: u 0 0 0-0081 0-0016 0-0037 
Xo-o1 \v 0 0 0-0081 0-0016 0-0037 
10 , u | 00547 0-0548 0-0473 0-0328 0-0702 
Xt-0s ty 0-0107 0-0123 0-0473 0-0328 0-0128 
, u 0-0107 0-0123 0-0106 0-0064 0-0128 
Xo-o1 \v 0-0010 0-0025 0-0016 0-0064 0-0017 

















This res. tt is true whatever b. It may be noted that any function of the type 
k k b 
¥p4{ log, (1 p> rs Ap) | , 
i=1 j=i+l 
where A is a constant, will have the same limiting moments. 


7. The error involved in assuming that —2log,u (or —2log,v) is distributed as y? with 
two degrees of freedom was investigated numerically. We have 


Antilog, (— 4x2) = € 


for two degrees of freedom, and we choose ¢€ to be 0-05 or 0-01, these being the commonly 
used significance levels. It is accordingly straightforward to find the actual probability of 
u (or v) being less than 0-05 or 0-01, the formal significance limits. These probabilities are 
given in Table 3 for three different values of n and five different values of p for the binomial 
(q+p)”. It will be seen that when n = 10, provided p is not too different from 4, P{u < 0-05} 
and P{u < 0-01} are not very different from their nominal values. 
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8. We now turn to the distribution of the discontinuous random variable u, when the 
mean is fitted from the data. For the Poisson distribution the mean determines all pro- 
babilities; for the binomial, (q+ p)", n is often known, but the mean is necessary to determine 
p and hence the probabilities. We shall therefore discuss the moments of the function 


i-1 
U= ZPst $D;, 


when the p’s have to be estimated from a random sample of N observations. 

It is assumed that the variable may take values 2,, X2, ...,%,. (For example, in the binomial 
distribution these will be 0,1, 2,...,4—1.) The sample consists of N units or observations, 
n, of which take the value x; ‘i = 1, 2,...,4). We let the mean of the sample be X/N or we let 

NX +NgXat...+Ny,r, = X. 
Define the function F,(x,;, X) as = a 
F(x; X) = = P,+ 404) . 
We shall write for brevity a 
Fa|X) =(S8,+40) 


where #; indicates the value of p; as estimated from a sample with fixed mean X/N. We have 
that for all samples 


k 

& PF (eX) = 6(F,(x,, X)) = L PIX} OR (% | X)), 

4= 
the summation being taken over all the possible values of X. Further 

k 
é(F,(x; | X)) = Zhe | X) P{x;| X}, 
so that 6(F,(x;,X)) = XY P{X} Pf{a, | X} F(x, | X). 
xi 
For a fixed X the probability of getting a partition of N which is 7,, ng, ..., n,, is the multi- 
nomial chance MN! nee " 
it! mg! 1,1? Pa? + Pets 

which we shall write for brevity as P{n,, ng, ...,n,}. It follows that 


Piz} 1 


P{x,| X} = P{X} = PE VP -00y Meh 


where >)* means the sum over all possible k partitions of N when X is fixed. Substituting 
x 
this value in &(F,(z,| X)), we have 
Mutt, 20 ; + 
(F(x; | X)) ss P(X} » F(x; | X)> We ty Me» seep Mphe 


We now write the multinomial chance as a product, 


“ Ps® 
P{n,, Ng, ...,%} = ae , (a) 
nm ! Ps" 
and we have that WE ita May «++ Me} = (N- 1)! p, MOO, (A) 
e=1 %: 


where the superfix (7) indicates that n, is to be replaced by n,;—1. Thus 


» - n;—1 n nm 
rcyPe’ _ Epes PEty pet pitt pee 
e=x1 M,! 4! _! 4_!(n~—1)!,,;! my! 
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It will be remembered that 2,, x3, ..., 2, are fixed values that the variate may take. Since X 
is fixed we know that the probability of a partition of N into k parts so that 

k k 
X14%,=X and Yn=N 
i=1 i=1 
is given by («). We have in () one variable missing from the ith group. Hence () gives us the 
probability of a partition of N into k parts where 


k k 
= n,x,= X—x, and an = N-1. 
It follows that 


n kts 
Ly Ph Me» 110%} = D*(N-1)! p, oes 
x x s=1 N, + 


= p,;.P{sum of N —1 variables = X — ,}. 


and that 
tk 
&(F(x,| X)) = Py a | X).p,.P{sum of N —1 variables = X —z;}. 


Finally on substitution in @(F,(z;, X)), we have 


k 
E(F,(x;,X)) = DO F(x; | X) p;. P{sum of N —1 variables = X —x,} 
Xi=1 
k fi-1 SY 
=>> ( Y p+ 12) .p;-P{sum of N — 1 variables = X —;,}. 
xi=1\j=1 


9. The theory as set out is applicable to any discontinuous variable, the elementary pro- 
bability law of which is defined by the values 2,, x, ...,%,, with corresponding probabilities 
Py» Po» --+» Py. We now consider the special cases of Poisson and the binomial. 


(i) Poisson’s binomial limit 

Assume that a sample of N observations has been drawn from a population which is 
described by Poisson’s binomial limit with unknown parameter m. If the mean of the sample 
is X/N, then " e-XIN(X/N)i 
where j may take values 0,!,2,...,00. The sum of N—1 variables is itself distributed as 
Poisson with parameter (N —1)m, and therefore 


> 





@ (i=l... \P mie-meN—Dm (m(N — 1))X-# 
é f, i X aa ( + ‘ } } Tats 
(F(x, X)) 2% PP tp i! (X —i)! 
1\*-*/1\# 
Noticing that (W-1*= w(t i x) (x) ; 


after a certain amount of rearrangement we have 





_ etm (Nm)X & (1. ay (AY 1) 
(E(x, X)) = & Xi >) > i+ bay) xc,(¥) (1 x) ; 


giving the moments of the probability integral variable whose elementary probability law 
is Poisson with mean estimated from the data. 
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(ii) The binomial 
Assume that a sample of N independent observations has been drawn from a binomial 
population (¢ +p)", where the parameter n is known but 7 is unknown and must be estimated 


from the data. Here x; may take values 0, 1, 2, ...,n. The sum of N — 1 independent binomial 
variables is itself distributed as a binomial variable with index (NW —1)n. We have then 


a Xx \i X \-j 
a) (-sy) 


eys( 5341 at [(N — 1) n}! ~tg(N-1) n—X-44 
6 Few X) = BE (S8,+40) ae iin Toeenti Naa xan ig(N-1)n- X44, 


and 





which on rearrangement gives 
n rX, C;. Nn— EC 
(Fay X) = ECxP*a"-* 5: (59,4 40,) sae 

Thus, for any discontinuous variable, the moments of the probability integral variable can 
be worked out when all the parameters of the probability law are known except the mean, 
which is estimated from the data. From the expressions given it would be possible to decide 
what the size of the sample must be before the effect of estimating the mean can be neglected, 
so that the moments approximate closely to those of the distribution of the transformed 
variable when all the parameters of the probability law of the original variable are known. 
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HOW BALANCED INCOMPLETE BLOCK DESIGNS MAY BE MADE TO 
FURNISH ORTHOGONAL ESTIMATES IN WEIGHING DESI NS 


By K. 8. BANERJEE, Pusa, Bihar, India 


1. SuMMARY 


Arrangements given by balanced incomplete block designs may be utilized as efficient spring 
balance designs (Banerjee, 1948). When these arrangements are used as such as weighing 
designs, it is not possible to get mutually orthogonal estimates. A method has been detailed 
here to show how these arrangements may be made to furnish orthogonal estimates. 


2. INTRODUCTION 


Let x;,, = +1, —1 or 0, if the ith object at the ath weighing is placed in the left pan, right 
pan or in neither. Here i = 1,2,...,p and a = 1,2,...,N (p< WN). Let b; be the weight of 
the ith object, y, the record of the ath wéighing when the weight is placed in the right pan 
(or the negative of the weight placed in the left pan) and e, a random variable distributed 
about zero with variance o?. The weighing of N linear combinations of p objects in a balance 
will then result in N linear equations of the form’ 

X1q0y + Xeqdgt ... +X yqdy = Ya + Eq: (1) 
The matrix denoted by X = [z,,] is known as the design matrix. The normal equations 
giving the least-square estimates may be written in the matrix notation as [X'X]B = X’Y, 
where X’ is the transpose of X, B and Y are the column vectors 6, 6, a 6} and {y, Yo... Y¥y} 
respectively and 6; is the least square estimate of b;. The diagonal elements a“ of the reciprocal 
matrix [X’X}-! will represent the variance factors, the variance of the ith object being given 
by ao”. The sum of the squares of the residuals divided by the degrees of freedom (N — p) 
will give an estimate of o?. 

The estimates are given by B = [X’X}°X’Y. i 

We have | pp’) = ([X’X]" X’][[X’X]2X) = [X’'X]}? X’X[X'X} = (X'X}. 
From the above it is clear that if the estimates of the objects are available in mutually ortho- 
gonal linear functions of the variables y, (« = 1,2,..., N), [X’X]~ will be a diagonal matrix. 
The constitution of [X’X]-1 will therefore reveal if any of the estimates is non-orthogonal 
te the rest. 

In a chemical balance, the object may be placed in both the pans so that the design matrix 
will have +1, —1 and 0 as its elements, but in a spring balance the elements of the design 
matrix are restricted to be either +1 or 0. 

Hotelling (1944), the originator of the problem of weighing designs, has shown besides 
other things that the chemical-balance design of maximum efficiency is obtained when the 
design matrix X is orthogonal, consisting of +1 as its elements. Kishen (1945) pointed out 
that such a matrix can always be constructed when the number of weighings N = 2° (r any 
positive integer). Mood (1946) has pointed out that the construction of the chemical-balance 
design of maximum efficiency is connected with the Hadamard determinant problem and 
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has shown that the chemical-balance design of maximum efficiency with N weighings exists, 
if the Hadamard matrix H,, exists. Plackett & Burman (1946) have constructed all Hada- 
mard matrices up to 100 except 92. Mood (1946) has shown further that if a Hacamard 
matrix Hy exists, the spring-balance design of maximum efficiency also exists. The order of 
such a design matrix is less than that of Hy by one. Such designs have been denoted as Ly. 
It has also been proved by Mood that when the number of objects p is odd and = 2k—1, 
the most efficient spring-balance design is obtained when all possible combinations of the 
objects are weighed k at a time. Such designs have been denoted by Mood as P,,. The present 
author (1948) has shown that the arrangements afforded by balanced incomplete block 
designs furnish the same efficiency as the P, of Mood. He has also pointed out (1948) that 
the designs L,, are given by a special class of symmetrical balanced incomplete block designs. 
Kempthorne (1948) doubted whether the optimum spring-balance design Ly of Mood would 
be practically useful in view of the fact that I, furnishes correlated estimates. Kempthorne 
suggested that fractional replicate designs which afford uncorrelated weights were perhaps 
preferable to the optimum design Ly of Mood. The present author, however, showed (1949) 
that the design Ly of Mood can also be made to furnish orthogonal estimates, and that these 
two types of designs are virtually of the same nature. In fact, a slight modification in one gives 
rise to the other. The nature of the original example of Yates (1935) has also been shown in 
the note referred to above. 

It is now intended to show here that the arrangements given by balanced incomplete 
block designs in general may also be made to furnish uncorrelated estimates, and that the 
solution in the case of L,, comes only as a particular instance of the general solution proposed 
to be discussed here. The identities of Fisher & Yates (1948) well known in the theory of 
balanced incomplete blocks, bk = vr, A(v—1) = r(k—1), have been frequently made use of 
in the analysis in connexion with this note. 


3. WHEN A BALANCED INCOMPLETE BLOCK DESIGN IS USED 
AS SUCH AS A WEIGHING DESIGN 


Usually v and 6 are used to denote respectively the number of varieties and the number of 
blocks in balanced incomplete block designs. In weighing designs, v takes the place of p, 
the number of objects to be weighed, and b that of NV, the number of weighings to be made. 
r and A, however, have similar meanings to those in connexion with balanced incomplete 
block designs; that is, r is the number of times each object is weighed and A the number of 
times each pair is weighed together. (The analysis henceforward will be written in terms of 
b and v instead of N and p.) The matrix [X’X] in general will take the form 








oe ge See 
ew eee 
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(2) is of order v x v. The diagonal elements in the matrix reciprocal to [X’X] will be all positive 


and equal to 
r+A(v—2) 


(r—A) {r+A(v—1)}’ 





(3) 


4-2 
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while the remaining elements in the reciprocal matrix will be all negative and equal to 


A 
~ =A +FAO= Dy 


(4) shows that the estimates will be correlated. 





4. WHEN A BALANCED INCOMPLETE BLOCK DESIGN IS ADJUSTED 
TO SUIT A BIASED SPRING BALANCE 


If the balance has a bias, it will be necessary to modify the design matrix to suit the 
estimation of the bias or that of the weights free of the bias. Taking the bias as an additional 
object to be weighed, a column of ones and only one row of zeroes in that order may be added 
to the design matrix to correspond to the bias supposed as an additional object. The design 
so obtained will then be suitable for the estimation of the weights. This means getting an 
estimate of the bias by only one weighing operation and subsequently weighing the com- 
binations of the objects along with the bias. If, however, a column of ones and ¢ rows of 
zeroes in that order are added to the design matrix, this will imply devoting ¢ weighings to 
the estimation of the bias. In such a situation, the matrix [X’X] will be of the form 








rest FT we 4 

ee 

Silo OY adeowd (5) 
D winVAe em ei 


The order of the above matrix is one more than that of (2) because of the inclusion of the bias 
and is equal to (v+1) x (v+1). 

I. The value of the determinant 

| X’X | = (r—A)?* [(6 +t) fr + A(v— 1} — 1°] 
= t(r—A)’* {r+ A(v—1)}. 

II. The value of the determinant obtained after suppressing the first row and the first 
column of | X’X | is (nA) fr +. A(v— D)}. 

IIT. The value of the determinant obtained after suppressing the second row and the 
second column of | X’X | is 

(r—A)™-*[(6 +8) fr +A(v—2)} —r(0-1)]. 

IV. The value of the determinant obtained after suppressing the first row and the 

second column of | X’X | is 
r(r—A). 


V. The value of the determinant obtained after suppressing the second row and the 
third column of | X’X | is 
(r—A)’-* {A(b +t) — 1}. 


If the value of t be so chosen that 


2 
Ab+t)—r2=0, ie. t=>-6, (6) 
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the value of (V) will be zero and that of (III) will reduce to #(r—A)’-* {r+ A(v—1)}. Using 
(6) and the identities in the theory of balanced incomplete blocks referred to before, r—A 
may be shown to be equal to tkA/r. The matrix [X’X]- then reduces to 


= oe ee => 
;° eae ee 
1 r 
1 r , (7) 
~ 
1 r 
I . . tka 








(7) shows that except for the estimate of the bias, the other estimates will be mutually 
orthogonal. The estimates of the bias as well as those of the objects will be available as 


Pas AS Sg elt @ } 
t t t 
1 1 WS oe | 1 
, -1 .— Ee Pa = wen eo 
eae eo £. @ xf es ole (8) 
B sidederdt tobe dnote St 
te «otk: otk or otk ithe 








For every 0 and 1 in all rows of X’ except in the first, there will respectively be — 1/tk and 1/r 
in all the rows of (8) except in the first. The elements in the rows of (8) are the coefficients of 
y, in the linear functions estimating the weights of the objects. It is easy to see that the sum 
product of the coefficients in any two linear functions estimating two objects is equal to 


apt *(5) + alia) a we (*) -%)> (9) 


where A, = b—2r+A. (9) on simplification may be shown to be equal to zero. 


5. SITUATION IN A COMPLEMENTARY BALANCED INCOMPLETE BLOCK DESIGN 


Given a balanced incomplete block design with parameters v, 6, r, k, A, it is always possible 
to obtain another with parameters 

V=v, b=b, ro=b—-r, ky=v—k, Ayg=b—2r+dA, 
by replacing each block by its complement. Two such designs are called complementary to 
one another. The distributions of ones and of zeroes in X furnish the two designs, which are 
complementary to one another. 

When an integral value of ¢ is available as given by (6), it is possible to get the orthogonal 
estimates also from the complementary design. In this situation a column of ones and 
t rows of ones in that order have to be added to the design matrix X to achieve the desired 
object. The matrix [X’X] will then take the same form as (5), where r’ = r9+¢and A’ = Ay+t 
are substituted respectively for r and A. The value of the determinant obtained by suppressing 
the second row and the third column of | X’X | in this case will be given by 


(r’ — A’ P28 {A'(b +t) 17}. (10) 
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It is easy to see that (10) vanishes, as 


A'(b+t)—r’? = (Apt t) (b+8)—(ro +t)? 
= (b—2r+A+t)(b+t)—(b—r+t)? 





= 0,.. by (6). 
It can easily be shown by using (6) and the parametric relations that 
P — 
r=tk, N= oO » f-XrV = = and r’+A’(v-1)= {14 E=" ~} 


The matrix [X’X]- in this situation will then reduce to the form 











7 1 1 ae 
file Ping BRB = 
1 r 
WS... a 0 0 
r > 
r 9 HRA 
1 r 
f aa a rT 0 0 eee tka | 
1 tk(k —1) ; ae , ; 
where ¢ = $ 1+ - . The estimates of the objects will be given by 
wy v v ko ko ky 7 
Natick, Kitetiai Cole T woke La 
Body Bir Li nal gh 
[X'X] 7? X’ = tk tk tk r a, Bonu! ee (11) 
~ hae Salata 2 art ine = 
)& -ohhoe sto -t tk 








For every 0 and | in all the rows of X’ except in the first, there will respectively be — 1/r 
and 1/tk in all the rows of (1)) except in the first. The sum product of the coefficients in any 
two linear functions estimating two objects will be exactly the same as (9). 

It may be noticed that the variance factor for an object in the complementary design will 
be the same as that of the original design. 

In the case of Ly as given by a symmetrical balanced incomplete block design, ¢ = 1, so 
that only one additional row has to be added to the design matrix to suit the estimation of 
the bias. The treatment given in the note referred to before (Banerjee, 1949) in respect to 
Ly is, therefore, obtained as a special case of the general procedure outlined here. 


6. SOLUTION OF A MORE GENERAL NATURE 


The above procedure will fail to furnish orthogonal estimates when r*/A is not an integral 
number. A solution by the above procedure, however, always exists for all designs when 
A = 1. When r* is not divisible by A, we can find the least integer £ such that (r + £)* is divisible 
by A+. If a column of ones and £ rows of ones and 7 rows of zeroes in that order are added 
on to the design matrix to suit the estimation of the bias in a biased spring balance, the matrix 
[X’X] will be of the same form as (5), where the left top element will be b+£+7, andrand A 


A 


di 


(11) 
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will respectively be substituted by r” = r+ and A” = A+ &. The value of the determinant 


| X’X | obtained by suppressing the second row and the third column will be equal to 
gs (r” —A"P-8((b4 E+ 9) (A+E)—(r +E). (12) 
=? (b+ E+) (A+) (r +E)? = 0. (13) 


Knowing that (r+)? is a multiple of (A+), the value of 7 will be determined by the con- 
dition (13). 
The results corresponding to I, II, III and IV of § 4 reduce respectively to 
(r—A)P(b+E+m), (r—A)P*{r+A(v—1) +e}, 
(r—AyP"*(b+E+) and (r+&)(r—A)r. 


The matrix [X’X]-! will therefore be obtained as 











rc au) visa ic ty, ool 
1 
1 
peardet 0 0 r—A | 
r+A(v—1)+év r+é 
rh A= d Oe ee, 
— @+E+m(r—aA) (6+E+) (r—A) 


The above matrix is of order (v +1) x (v+1). The estimates of the bias as also those of the 
objects will be given by 


y terms € terms The column vector 
B.D A incl E E E of the records of 
'@ site ei as Se i fe 2: 2 a se weighings, which |, (14) 
FF cle, whe Ocal vA wines are (6+£+7) in 
eee eee eee eee eee eee eee Tee eee ee eee ee eee eee eee) number 
where D=A-vC, B=A-kC and F=-C+—. 


For every 0 and 1 in all the rows of X’ except the first, there will respectively be F and —C 
in all the rows of [X’X]- X’ of (14) except the first. The elements in the rows of the matrix 
[X’X]-1 X’ are the coefficients of the records of weighings in ‘he linear expressions estimating 
the weights of the objects. 

The above analysis shows that the more general class of balanced incomplete block designs 
may also be made to furnish orthogonal estimates. It is also possible to get orthogonal 
estimates from a design, which is complementary to this design. To do this we add to the 
design matrix 9 rows of ones and & rows of zeroes instead of adding rows of ones and 7 rows 
of zeroes as was done in the former situation. The proof follows from the fact that 


(b+ +E) (Ag+) — (rot)? = (b++8) (b—2r+A+m)— (6-7 +0)? 
=0, by (13). 
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7. NUMERICAL ILLUSTRATIONS 


The design matrix X in an L, (i.e. in a symmetrical balanced incomplete block design afforded 
byv=7,b6=1,r=4,k = 4, A = 2) is given by 


e.38 8 6.41 
,; ewe is 
0001111 
Zuit 1-8 @1.4 04, 
So. st tton 
SS ae oe Oh Bh oo 
Srrrre 








where the rows refer to the weighing operations and the columns to the objects 5,, be, ..., 6, 
to be weighed. 

Seven small copper pieces have -been arbitrarily chosen as the objects for the purpose of 
this illustration. The results of weighings (in grams) of the combinations of objects as given 
in the above design matrix are 10-76251, 7-83798, 6-11380, 12-07808, 8-90452, 10-63856 and 
12-80768. (The fifth decimal place of these records has been determined by the method of 
oscillation, and no temperature and vacuum corrections have been made as the purpose was 
not to find the accurate weights of any specific objecus.) 

The left-hand side of the normal equations will be given by a square matrix [X’X] of order 
7x7, whose diagonal elements are 4 and the elements elsewhere are 2. The right-hand side 
(i.e. the numerical side) of the normal equations is given by 

Z, = 46-28683, Z, = 41-62826, Z, = 38-14357, Z, = 38-46456, 
Z, = 37-85891, Z, = 3666842 and Z, = 37-52197. 

Subtracting from each of these one-eighth of their total, and dividing by 2, the estimates 

are obtained as 

6, = 585763, 6, = 3-52835, 6, = 1-78600, 6, = 1-94650, 
6, = 1-64367, 6,=1-04843 and 6, = 1-47520. 

The matrix [X’X] shows that the estimates are correlated. They may, however, be obtained 
as orthogonal functions of the records of weighings, if the weighings are made in a biased 
spring balance. It has been pointed out in § 5 that in the case of Ly,t = 1,so that a column of 
ones and only one row of zeroes have to be added (in that order) to the design matrix in order 
to get orthogonal estimates. This means that the measure of the bias of the spring balance 
has to be obtained by only one weighing operation and the remaining combinations have to 
be weighed as such in the biased balance. The records of weighings and the modified design 
matrix are shown below, the bias being denoted by by. 


by b, by by by bs be b, g. 
10000000 = = 0-00101 
1101010 1 = 10-76379 
101100411 = _— 7-83990 
10001111 = + 611580 (15) 
1110011 0 = 12-08000 
1014141100 =~ 890543 
1101101 0 = 1063998 
1110100 1 = 12-80998 
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The solution of the normal equations giving the estimates is straightforward. The 
constitution of the matrix [X’X]'X’Y assists in appreciating how the estimates are 
obtained as orthogonal linear functions. On substitution of the values of the parameters, 
this matrix reduces to 





os 0 0  ... © | [The column vector) 
—} +}1..-} +} of the 8 records 
f weighings in 
«<3 tp Se of weighing (16) 
vial iy, Matte. (15) 
L ECeES “4g +4 . 








The above furnishes the estimates as 
6, = 0-00101, 6, = 5-85790, 6, = 3-52868, 6, = 1-78558, 
6, = 1-94662, 6, = 1-64354, 6, = 1-04887 and 6, = 1-47576. 
The calculation leading to the solution may be simplified as follows: 
Let —1 be put for every 0 in all the columns of the matrix (15) except in the first. The 
columns then consist only of + 1 and — 1 as their elements. The algebraic sum of the records 
of weights corresponding to the minus and plus signs of a particular column divided by 4 


(i.e. &) will give the estimate of that object which the column represents. 
The balanced incomplete block design given by 
f=, v= 8, k= 4, 6 = 14, A=83, 

will not furnish orthogonal estimates when used as such as a spring-balance design. Here, 
also, orthogonal estimates may be obtained, if the design matrix is modified to suit the estima- 
tion of the weights in a biased spring balance as suggested in §6. In the present instance, 
£=1, 7=1. Records of weights and the modified design matrix are shown below. An 
additional copper piece was taken to make the number of objects equal to 8. 


by b, by bs by bs be by bg g. 
11 21°1 £1 1°2 = 18-91670 
100000000 =~ 000101 
1111100 0 0 = 1312036 
111000011 = 1249119 
1101001 01 = 1032320 
1100101 1 0 = 1032997 
10000414111 = &79780 
100111100 =~ 642631 (17) 
10101101 0 = _ 859500 
101101001 =~ 858860 
ruitk@®01100 m= 07040 
11010101 0 = 1076320 
11001 10 01 = 1108093 
10014100411 = 683861 
1010101041 =~ 815469 
101100110 783968 
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When the numerical values of the parameters are substituted, the matrix [X’X]"* X’Y 
takes the following form: 


—te v wvs wve -- te || The column vector 
+4 -4 +3 +4... -} of the 16 records 
sdiececucancttace ceased ssstedsdecedeeon of weighings in 
Sees See ae Eee sk 


The estimates are obtained as 


6, = 0-00132, 6, =5-85791, 6, = 3-52807, 6, = 1-78583, 6, = 1-94731, 

6,= 1-64365, 6, = 1-04861, 6,=1-47471 and 6, = 1-62960. 
Here, also, the calculations may be simplified as in the above instance. In this case, the 
algebraic sum has to be divided by 8 instead of 4 to get the estimates. 

No attempt has been made here to estimate the error from the observations. There will 
be no degrees of freedom left for the estimation of the error variance in case of L,, as only 
seven observations were utilized in estimating the weights of seven objects. Only 1 and 
7 D.F. will be available for the estimation of the variances in the other two illustrations. 


The numerical illustrations have been added subsequently to this note according to the 
suggestion of a referee, to whom my grateful thanks are due. 
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THE POWER OF THE y? INDEX OF DISPERSION TEST WHEN 
NEYMAN’S CONTAGIOUS DISTRIBUTION IS THE 
ALTERNATE HYPOTHESIS 


By G. I. BATEMAN 


1, The index of dispersion is commonly used to test for the equality of variance and mean 
under the hypothesis that observations have come from a Poisson population. Thus if there 
are N random independent variables 2,, 72, ...,%y, each following the same Poisson law, it 
is known that the quantity 

N 

a (x,—2)? 

at <- SSe eee 1 
z = (1) 

is approximately distributed as x? with N — 1 degrees of freedom. The exact distribution of 
zis not known. Hoel (1943) found the first four moments of the distribution, using Fisher’s 
k-statistic technique. If m is the population mean of the Poisson distribution, he showed that 
the moments of z are 





My4(2) = N- 
1 1 
ple) = 20-1) 1-75 -E i 
pe) = 8(N—1)] 1 +5--yot- ch f (2) 
6 2 
H4(2) = 1-1) 434545554... 


where the terms in square brackets are correct to 1/(Nm)*, 1/Nm, and 1/(Nm)?° respectively. 
Hoel carried out a numerical investigation and reached the conclusion that for m>5 the 
x? approximation to the distribution of z is highly satisfactory, even for V, the number of 
observations as small as 5, and is fairly accurate for m < 5, although it will tend to give too 
few significant results. 

2. Suppose now that the probability law of the observations, x, is represented by Ney- 
man’s contagious distribution. This may be written as 


P{x,; = 0} = exp (andl 7) 
(for + = 1,2,...,.N;¢#=0,1,2,...), (3) 





Pa, =t+l}= _ bo mt Pte, =t—}j} 
where MM. = fly, 
mM, M,(1 + mg) = fig. 


When there is no ‘contagion’ present in the material observed, then 


M>O, M>0 and mm,=m, 











60 Power of 4? index of dispersion test 


the distribution becoming that of Poisson with parameter, m. The moments of the index of 
dispersion, z, of (1), under the hypothesis described by (3) may be found using the same 
technique as did Hoel. Thus we have 


’ Fi ae Neg = m2 uy 2ms 
i iad oe i Nmm, (Nm,m,)? (Wm, m,)5 * ES 

















M\2 + Mz) 1 m,(2 —m?) 

= (N—1)] 2(1 S4.<= . oe 241 15m? + 2m3 + 2 2 
Hal2) = (N yf 2 +m,)'+ Nic, Mg Tam + Aeets te + eet MMs 

1 e m,(2 + 4m, + m3 — 2m) 

~—__-___ (2— 10m, — 20m2 + 5m3 + 2m4 + ~2 atms—2m5)\ 
mma ee M1 Mz saat 

4 m,(4 + 8m, + m3) 
(2) = av —a)[ 8(1-+m,)9+ = jo -( 1+ 12m, + 20m§ + Omg +-mf + 2 aa ») 





- (8 + 60m, + 103m3 + 57m} + 8m} + (79 + 248m, + 160m§ + 24m3)) 


Ms 
~ Nm,m 2m, Mz 
9—5m 
ae ar 2) +.. | 
2(m,mz) 


M~(2+ mee | 


2m, Mz 


M4(2) = 12(N —1)? | (+m, r+ 


1 
+12(N-1) [4a +mq)*+ (6+ 60m, + 147m3 + 136m3 + 49m + 6m8) 
2 


+ = (4 + 168m, + 694m3 + 828m3 + 371m + 72m + 48) 


6(m,m,)* 
Me 
12(m, Mz) m,M.)® 

If we put m, = 0 and m,m, = m these moments reduce to those given in (2). 

3. These expressions for the moments of z are complicated in form, but there is an im- 
mediate simplification if either m,m,, or N, or both, is sufficiently large. The first four 
moments, as well as being correct to terms of order N-*, N-1, N° and N, respectively, are 
also correct to terms of order (m,m,)~*, (m,m,)~*, (m,m,)-! and (m,m,)°, respectively. 
Hence, for m,m, sufficiently large, we shali have 

pi(2)=(N—1) (1+), — fg(2) = 2(N —1) (1 + 2mg)?, 

ig(2) = 8(N —1)(1-+2mg)®, peg(z) + 12(N — 1)2(1 +mq)* + 48(N — 1) (1 sna 
These are the moments of (1 +m.) x”, where x” has N — 1 degrees of freedom. We may assume 
therefore that for Neyman’s contagious distribution the index of dispersion is distributed as 
x7(1+m,), provided the population mean is sufficiently large. It often happens in bacterio- 
logical work that this is the case (see, for example, R. A. Fisher, Statistical Methods for 
Research Workers, §16). In field ecology, when counts are made on an abundant species, 
and the quadrat used is not too small, this condition is again realized. 

4. If N is large then, regardless of the size of m,mz, we have, from the first two equations 
of (4), M,(2+ mz) 

2m,m,(1 + 2) 


(8+ 56m, + 483 + 25m} + 9m) | +... (4) 


(5) 





py(z)=(N—1)(1+m,), f(z) =2(N—1)(1 +m, (14 (6) 


and /,(z) and £,(z) tend to 0 and 3 respectively as N increases without limit. Thus we may 








assume that z—(N —1)(1+m,) (7) 
(20v —1)(1+m,)? (: + Spl) 
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tends to be normally distributed with zero mean and unit variance as N > oo. If, in addition, 
mM, Mz, is large, z—(N—1)(1+m,) ‘ 

(T+m,)(2(V—1)} ' 
tends to be normally distributed with zero mean and unit variance. This last is of course 
another way of saying that, as N +00, (1+mz,) x”, where x? has N —1 degrees of freedom, 
tends to be normally distributed. A closer approximation will be to make use of the fact that, 
for large N, ,(2x”) tends to be normally distributed with mean ,/[2(N —1)—1] and unit 
variance, and we have in fact used this approximation below to obtain 


P{(1 +2) x* > Xb0s}; 
when N > 100 and ¥2,,, is the value of y? with N — 1 degrees of freedom cutting off 0-05 from 
the right-hand tail area. We note further that (7) differs very little from (8) even when m,m, 
is not large, the difference in denominators being less than 5 % for m,m, = 5. Thus if N is 
large, even if m, mz is not large, the distribution of z should be well approximated by that of 
(1+) x”. 

5. Calculations were carried out with a view to determining how large m,m, should be, 
when N is not necessarily large, and m, is given, for the y* approximation based on the 
moments (5) to hold. The ratios of the first four moments of z to the corresponding moments 
of (1+ mz.) x? are referred to as R,, R,, Rj, Ry, respectively, and the values of these ratios for 
certain values of m,m,, m, and N are given in Table 1. From a study of this table we notice 
that in no case do the first two moments differ greatly from those of (1 +m.) x*.* The most 
extreme case shown is that for which m,m, = 5,m, = 2,and N = 5and in this case the means 
differ by 3 % and the standard deviations by 8 %. In studying the ratios R, and R, it should 
be borne in mind that £,(x?) > 0 and £,(x?) > 3 as Noo. Now 


R2 R 
B,(z) = pa Pil) and £,(z) = Behar”) 


and it follows therefore that /,(z) > 0 and £,(z) > 3 as N 00, since R,/R}> 1. Thus although 
R, increases with N, yet the (£,/,) point for z, if N is large, will be close to that of y? with 
N —1 degrees of freedom as we have pointed out previously. We regard the position as 
satisfactory for N = 50 and m,m, = 5 and m, = 1. For the same N and larger m,m, or 
smaller m, the position will be even better. 

6. As pointed out above, Neyman’s contagious distribution of (3) may be regarded as 
depending on two parameters m,m, = m and mg, where 1 + m, is the ratio of the variance to 
the mean. If m, = 0 and m is fixed it becomes the Poisson distribution. Suppose now it is 
wished to test the hypothesis that m, = 0 against an admissible set of alternative hypotheses 
defined by (3), using a significance level a. We may do this by using the index of dispersion, z. 
The power of this test with regard to a specific alternative defined by m, = M, will then be, 
approximately, P{z> x2 | m, = My} = P{(1+ M,) x? > x3}, (9) 
where y? follows the standard distribution with N — 1 degrees of freedom and ¥? is the signi- 
ficance level a of standard tables. Fig. 1 shows the power obtained in this way, plotted against 
(1+ m,) for a number of values of N. The curves must be read bearing in mind the restrictions 
imposed in approximating to the distribution of (1+ m,)x*. For N = 50, and upwards, it 





* It is doubtful whether the order of approximation used in obtaining the moments of z is sufficient 
to give R, and R, to first decimal place accuracy for cases where (m, mg) is small and m, large. These values 
should therefore be treated with reserve. They have been included because they serve to show the general 
trend, 
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Table 1. The ratios R,, R,, R5, R, of the first four moments of the Poisson index of dispersion, z, 
to the corresponding momenis of (1+ mz) x”, where x? has N —1 degrees of freedom. The 
probability law for the observations is Neyman’s contagious distribution with 4, = MyM, 
Hz = M,M,(1 + mM) 
































| 
M,mM,=5 M,M,= 10 MM, = 20 
m,| N 
R, R, R, R, R, R, R; R, R, R, Rs R, 
0 5/1 0-958 | 0-96 1-08 1 0-980 | 0-97 1-04 1 0-980 | 0-99 1-02 
10) 1 0-980 | 1-02 1-07 1 0-990 | 1-01 1-04 1 0-995 | 1-01 1-02 
20/1 0-990 | 1-06 1-05 1 0-995 | 1-03 1-02 1 0-998 | 1-02 1-01 
o}l 1 1-1 1 1 1 1-05 1 1 1 1-025 | 1 
0-5 5 | 0-9864 | 0-932 | 0-92 1-40 | 0-9933 | 0-986 | 0-97 1-18 | 0-9966 | 0-983 | 0-99 1-09 
10 | 0-9933 | 0-993 | 1-15 1-35 | 0-9966 | 0-997 | 1-08 1-16 | 0-9983 | 0-998 | 1-04 1-08 
20 | 0-9966 | 1-024 | 1-27 1-26 | 0-9983 | 1-012 | 1-14 1-12 | 0-9991 | 1-006 | 1-07 1-06 
50 | 0-9987 | 1-043 | 1-35 1-18 | 0-9993 | 1-022 | 1-17 1-09 | 0-9997] 1-011 | 1-09 1-04 
o}l 1-0556 | 1-3969 | 1-1142/ 1 1-0278 | 1-1969 | 1-0563 | 1 1-0139 | 1-0981 | 1-0280 
1-0 5 | 0-9792 | 0-903 | 0-87 1-57 0-9898 | 0-951 | 0-95 1-26 | 0-9949/ 0-975 | 0-98 1-12 
10 | 0-9898 | 0-988 | 1-20 1-49 | 0-9949| 0-994 | 1-11 1-23 0-9975 | 0-997 | 1-06 1-11 
20 | 0-9949 | 1-031 | 1-36 1-37 0-9975 | 1-016 | 1-19 1-17 0-9987 | 1-008 | 1-10 1-08 
50 | 0-9980 | 1-057 | 1-47 1-25 | 0-9990| 1-029 | 1-24 1-12 0-9995 | 1-014 | 1-12 1-06 
100 | 0-9990 | 1-066 | 1-51 1-21 0-9995 | 1-033 | 1-25 1:10 | 0-9998 | 1-017 | 1-13 1-05 
co }l 1-0750 | 1-5456 | 1-1556 | 1 1-0375 | 1-2708 | 1-0764 | 1 1-0188 | 1-1349 | 1-0379 





2-0 5 | 0-9709 | 0-849 | 0-75 1-79 0-9861 | 0-923 | 0-91 1-35 0-9932 | 0-961 | 0-96 


I-16 

10 | 0-9861 | 0-968 | 1-22 1-66 0-9932 | 0-984 | 1-13 1-30 0-9966 | 0-992 | 1-07 1-14 

20 | 0-9932 | 0-972 | 1-47 1-49 0-9966 | 1-014 | 1-24 1-23 0-9983 | 1-007 | 1-12 1-11 

50 | 0-9971 | 1-065 | 1-62 1-32 0-9987 | 1-032 | 1-31 1-15 0-9993 | 1-016 | 1-16 1-07 

100 | 0-9987 | 1-077 | 1-67 1-26 0-9993 | 1-038 | 1-34 1-12 0-9997 | 1-022 | 1-17 1-06 
co jl 1-0889 | 1-7237 | 1-1857 | 1 1-0444 | 1-3596 | 1-0909 | 1 1-0222 | 1-1793 | 1-0449 





















































will be seen that we are concerned with only small values of m,. It might therefore safely 
be assumed from the evidence of Table 1 that these power curves will be a good representation 
of the power of z when the mean is as small as 5, and for even smaller means as N increases. 
For the curves for small values of N, i.e. 5, 10, 20, the mean m,m, must be large for the 
(1+mz,) x” approximation to hold, unless m, is small. For high values of mg, i.e. when the 
power is large, it would be necessary (vide Table 1) for m,m, > 20 for this part of the curves 
to be accurate. Apart from these restrictions, we may note that the power is independent of 
the mean of the population. 

7. The (1+m,) x? approximation to the distribution of z is simple to handle and can readily 
be used, before the collection of data, to assess the size of sample required in order to have 
a given chance of detecting a departure from randomness due to clustering of Neyman’s 
‘contagious’ kind. Thus, using the 5 °% significance level, a sample of ten observations from 
a Neyman’s contagious population will only enable departures from the Poisson to be 
detected nine times out of ten when the variance of the distribution is actually four times 
the mean. In order to detect a 2:1 ratio with the same probability it is necessary to have 
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a sample of between thirty and forty. Large numbers of observations, but not large means, 
are comparatively rare in cases where the index of dispersion is used, and it is probably for 
this reason that clustering effects are very often overlooked and the hypothesis of randomness, 
as defined by the Poisson law, accepted. 

8. There is one further application which might be mentioned. We might use the index of 
dispersion to test the null hypothesis that samples have come from a Neyman’s contagious 
distribution with specified m,. For example, suppose we consider some potanical data 
provided by Archibald (1948). A plant community was sampled with a quadrat, the number 
of plants of Plantago occurring in each quadrat being noted. It was found that the distribu- 
tion of the number of quadrats containing 0, 1, 2, ... plants did not follow Poisson’s law, and 
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it was suspected that there was clustering of observations owing to the fact that this species 
is root propagated. In fact, a large number of observations was collected and Neyman’s 
contagious distribution was found to fit the data very well. If now further samples are taken, 
either from a different locality or from the same locality in a different year, it is interesting 
to ask whether the variance/mean ratio has changed. For Plantago, twenty samples were 
taken at a different time of year and we have the following quantities: 


20 
N=20, =205, 3 (x,—Z)? = 1285-0, z = 62-68; 


i=1 

from previous large-scale work it was found that m, = 2. Hence for 19 degrees of freedom 
P{x? > zo/(1 +m ) = 20-89} = 0-34. 

We should conclude from these figures that the variance/mean ratio in the population could 

have remained unchanged, even though the population mean itself might have altered. 
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POWER OF THE MODIFIED t-TEST (u-TEST) BASED ON RANGE 


By E. LORD, Shirley Institute, Didsbury, Manchester 


1. INTRODUCTION 


In a previous paper (Lord, 1947) we have indicated how estimates of standard deviation 
based on a total range, or on a mean range, may be used in the so-called w-test when con- 
sidering the statistical significance of either the deviation of a sample mean from some fixed 
or hypothetical population value, or the difference between the means of two samples. From 
tables at several probability levels, rapid estimates of the confidence limits within which the 
population mean may be assumed to be contained may also be obtained from a measured 
sample mean and the range or mean range among the individuals. It was pointed out that 
these applications of the range, in place of root-mean-square estimates of standard deviation 
in the ¢-test, nee: ssarily entailed some loss of precision. However, on the basis of some of the 
results now giver in full in the present paper, it was asserted that the reduction in accuracy is 
negligible for ali practical purposes, and is often compensated by the greater ease of computa- 
tion compared with the usual t-test. 

Whilst the original paper was in the press, a note by Daly (1946) was published in which 
a range test was suggested similar to one of the forms of the u-test. The case when the estimate 
of standard deviation is made from the total range in a single set of n values was discussed, 
and approximate values of the ratio (deviation)/(range) on the 10% probability level were 
given for several low values of n. For two particular values, the power of the range test was 
found comparable with the power of the conventional t-test. Walsh (1947) also considered 
forms of a significance test based on a single range '(n < 10) and suggested that, for samples of 
this size, discrimination is nearly as powerful as for the t-test. 

In various forms, the more general test based on the distribution of 

lull normal deviate 
independent range or mean-range estimate of standard error 





has been found useful in experimental laboratory work for considering significance of differ- 
ences between sample means and in estimating the accuracy of measures of average character. 
In the industrial field, its simple nature permits easy routine application to the detection of 
changes in average quality of processed batches of material and to determining quickly 
whether averages of samples, tested with a view to purchase or further use, deviate signifi- 
cantly from specified requirements. The present paper is therefore intended to justify more 
firmly the value of the w-test. In particular, it shows that, over a wide field of useful applica- 
tion, the power to detect the existence of differences is little less than that of the most powerful 
t-test. 

Use of the quantity ‘standardized error’ in preference to the power function often facilitates 
comparison of the two tests. It is shown, for example, that if the t-test detects a given real 
difference 19 times out of 20 when using the 5% probability level, then with the u-test this 
difference does not need to be more than 24% greater for it to be detected with equal fre- 
quency. Moreover, in many cases the real difference need only be 1% greater for the u-test 
than for the t-test. Thus for most practical purposes the difference in discrimination is of 
negligible importance. 
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When applying the u-test to medium and large samples, there is often a choice of size of 
possible subgroups into which the observations may be divided to form mean range estimates 
of standard deviation. Tables are given to indicate which grouping combination in a fixed 
total number of observations leads to the greatest power of the u-test. It can be shown that, 
as would be expected, the grouping combination giving greatest power is the same as that 
yielding the most efficient estimate of standard deviation. When the number of observations 
permit, the size of the subgroups should generally be n = 8, and in any case between n = 6 
and m = 10. Where the whole sample or samples may be divided in several ways into sub- 
groups of size 6-10, the choice of any one in preference to another does not, however, result in 
any appreciable loss in accuracy. 


2. THE POWER OF THE f-TEST 


To obtain results with which to compare the power of the w-test, it was first necessary to 
establish some new values for the power function of the t-test. If x is a variable normally 
distributed about a mean of zero, with standard deviation o, and if s is an independent 
estimate of o based on v degrees of freedom having the distribution 


(s) = ao gr—1 e—ts*o* (1) 

PS) = S=AT Gy) o* 

then the ratio t = x/s follows the well-known ‘Student’ distribution. The t-test may be used 

either in the symmetrical or asymmetrical form, according to whether we are seeking to 

detect changes in population mean in both directions or in one only. In the former case, 

using the 100a °%/ significance level, we reject the null hypothesis that the population mean 

£ = 0, if |t| >t,,, where 

° Ti(v+1)] 

a= P{lt}>4,}=2| = —— 
WP id= 2), ray Jem) 


The power function of the test gives the chance of establishing significance when £ +0. For 
a given @ and p, the power is a function of p = £/o and may be written 


Power = B(p) = f’(p) + A"(p); (3) 


where f’(p) and f"(p) are the probabilities that, when p> 0, t>t,, and t< —t,, respectively. 

Using the asymmetrical test, values of ’(p) were first given by Neyman, Iwaszkiewicz & 
Kolodziejezyk (1935) for « = 0-05 and « = 0-01. In the present paper, using the symmetrical 
test, we have taken 4a = 0-025 and 0-005.* 


(1+ #/v) 40+ dt. (2) 


(a) Computation of B’(p) and B"(p) for a = 0-05 


Putting o = 1 for convenience in calculation, we may write 


Bio) =f {sm aa | ple) de| de, (4) 


where p(s) is given in (1). The expression for £”(p) is obtained from (4) by writing —p for p. 
Except in the case vy = 1,2, where the integrals assume simple forms, computation was 
carried out by expressing (4) in terms of the Incomplete Gamma Function integral, I(u, p). 
Writing u= (4) a/R, Pp ‘= dv —1 
* Some results, presented graphically, for the symmetrical test with $a = 0-025 have been given by 
Ferris, Grubbs & Weaver (1946). 
Biometrika 37 5 
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we have from (4) B(p) = i A 
0 \(27) 
£"(p) is obtained by writing (x +) for (x—p), as before. 

Taking a = 0-05, and using tables of the ordinates of the normal curve and of the incomplete 
I’-function in (5), a series of framework values of £’(p) and /"(p) were obtained by quadrature 
methods for p = 1, 2, ..., 10 and v = 1, 2, 3, 4, 5, 9, 14 and 20. With argument proportional to 
1/v and reciprocals of f’(p) and /"(p) as variate, a seven-point Lagrangian formula was 
applied to points corresponding to v = 3, 4, 5, 9, 14, 20 and 00, and interpolation made of the 
components f’(p) and £"(p) for v = 6, 7, 8, 10, 12, 16 and 18. The interval was then halved 
using a nine-point Lagrangian formula to obtain the remaining intermediate values. The 
framework and interpolated values of £’() and #"(p) are given in Table 1 for integral values 
of p from 1 to 10 and v from | to 20. 

The sum f’(p)+/"(p) gives the power function of the symmetrical test (using a 5% 
significance level) with regard to.the alternatives p> 0 and p<0. On the other hand, /’(p) 
gives the power function of the asymmetrical test (using a 2} % significance level) with regard 
to alternatives p> 0. 

In dealing with the t-test, Neyman & Tokarska (1936) have defined the ‘standardized 
error’, p,, a8 the value of p for which 





e-x-P? T(u, p) dx. (5) 


1—A(p) = a." 


Thus, if we use the 5 % significance level, the chance will be 0-95 of establishing significance 
and 0-05 of failing to do so, if the population mean has shifted from its position under the 
null hypothesis by an amount £ = po9;7. In what follows we shall use f.9, aNd py, in order ~ 
to compare the efficiency of the t- and u-tests. 


(b) Computation of poo, and Poo, 

For « = 0-05, approximate values of 9.9; corresponding to (p) = 0-95 were obtained for 
the framework values of v by interpolation in Table 1. To the number of figures used in this 
table it will be noticed that at p = py»; the value #"(p) = 0, so that A(p) = f’(p). Accurate 
values of /’(p), and hence of f(p), were then determined for these framework values of v by 
numerical integration of (4) for a range of values of p (in steps of 0-005) close to the approxi- 
mate interpolated values of py.5,. The exact values were determined by subsequent backward 
interpolation; the value of (9; for indefinitely large v was obtained from integral tables of 
the normal curve, the limiting form of the ¢-distribution. 

For a = 0-01, tables of £’(p) and £"(p) had not been computed. The values p = fo.9, were 
determined for the framework values of v in a similar manner, first computing the values of 
£'(p) [equal to A(p) to the 5-figure accuracy used] by quadrature applied to equation (4) and 
then using backward interpolation. As before, the value of f»., for indefinitely large v was 
taken from integral tables of the normal curve. 

Lagrangian interpolation was then applied to these two sets of framework values to com- 
plete the range of values of p99; and py, given in Table 2. The values were differenced as 
a check and are probably correct to one unit in the last decimal place. 


* In terms of the ‘first’ and ‘second’ kinds of errors, this may be written Py = P;=a. 
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68 Power of modified t-test based on range 
Table 2. Standardized error of the t-test 
v Pos Poo v Po-0s Poo 
1 24-:975+ 163-99 13 3-907 5-67 
2 7-772 21-49 14 3-883 5-61 
3 5-654 11-76 15 3-862 5°55 + 
aa 4-928 8-97 
5 4-574 7-73 16 3-844 5-50 
17 3-829 5-46 
6 4-367 7:05 — 18 3-816 5°43 
7 4-232 6-62 19 3-804 5-40 
8 4-137 6-33 20 3-793 5-37 
9 4-067 6-13 
10 4-013 5-97 30 3-727 5-20 
60 3-665 — 5-04 
11 3-970 5°85 — 120 3°634 4:97 
12 3-936 5-75 + co 3-605 — 4-90 


























3. THE POWER OF THE U-TEST 


In the u-test, range estimates of the population standard deviation are used in place of root- 


mean-square estimates; thus x 


we Me”) = om, nd, = 
replaces ¢ where, as before, under the hypothesis tested, x is distributed normally about a 
mean of zero. The quantity @ = (m,n) is the mean value of m ranges, obtained from m 
independent samples or subgroups, each containing observations. The constant d,,* is the 
expected value of the range in samples of n, selected at random from a normal population of 
unit standard deviation. The ratio w(m,n)/d, is an estimate of the standard error of x 
determined from range. For a series of values of m and n, tables of the significance levels 
of wu were given in an earlier paper (Lord, 1947) for a number of values of «. 

Although the t-test is the uniformly most power:ul unbiased test of Student’s hypothesis, 
(Neyman & Pearson, 1936), for many purposes the w-test has the advantage of simplicity and 
ease of computation. In section (a) below the power of the w-test is investigated for the case 
where the estimate of the standard error of x is determined from a single range (usually the 
total range in a sample of n values of which the variate x is the mean). The case of m > 2 is 
considered later. As in the analysis of the t-test, the investigation is limited to the probability 
levels « = 0-05 and a = 0-01 in the symmetrical case; from this, generalizations may be 
drawn regarding the « = 0-025 and « = 0-005 probability levels of the asymmetrical case. 


(a) Computation of power and standardized error for the case m = 1 


The analysis follows lines similar to those used in the investigation of the t-test. If p(w) is 


the probability distribution of the range w in a sample of n observations, then corresponding 
to equation (4) we have 


B'(p) = [- {a3 erte-on [MN p(w) au] dz. (7) 


0 


* Values of d,, computed by L. H. C. Tippett (1925), have been published in many places; see, for 
example, Lord (1947, p. 67). 
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The percentage points, w,,, of the distribution of u are analogous to those, t,,, of the distribu- 
tion of t. The expression for £”(p) is similar to that of (7), obtained by writing (x + p) for (x —p). 

For n = 2, the values of £’(p) and /"(p) for u are identical with those for ¢ with v = 1, since 
there is one-to-one correspondence between the range and root-mean-square estimates of c. 
Again for indefinitely large n, the values of the power are the same for ¢ and u. For inter- 
mediate values of n, fresh computation is necessary. 


tdy/Uza 
For »>3, the integral { , p(w) dw was determined at intervals of 0-25 for x, using 
0 


manuscript tables of the integral [” p(w) dw tabulated to 5 figures and loaned by H. O. 
0 


Hartley. Using equation (7) with a value of « = 0-05, £’(p) and £"(p) were computed by 
quadrature methods for values of p = 1, 2,..., 10 and framework values of n = 3, 4, 5, 6, 10, 14 
and 20. A seven-point general Lagrangian formula, with argument proportional to 1/n and 
reciprocals of the variate, was applied to the points corresponding ton = 4, 5, 6, 10, 14, 20 and 
oo to determine values of f’(p) and £"(p) for n = 7, 8, 12, 16'and 18. The interval was then 
halved, using a nine-point Lagrangian, through even values of n from 4 to 20. The framework 
and interpolated values of the two components of £(p) are given in Table 3. 

Approximate values of the standardized error were determined for framework values of n 
by interpolation in Table 3. As before, in the region of p = fo.9;, we have f’(p) = £(p) to the 
limit of accuracy of the tabulated figures. A range of values of £(p) was obtained by applying 
quadrature to equation (7) for several values of p close to the interpolated approximate values 
of (9.95, P increasing in steps of 0-005. Exact values of poo, corresponding to f(p) = 0-95 were 
determined using backward interpolation. Lagrangian interpolation was then applied to these 
exact framework values of p).9, to determine the remaining corresponding values in the range 
of n from 2 to 20. 

For a = 0-01, tables of £’(p) and £"(p) were not determined over the field of p under con- 
sideration and consequently approximations to 99, could not be obtained by immediate 
interpolation as in the case of p99; above. Nevertheless, computation proceeded on similar 
lines: quadrature was applied to equation (7) for the framework values of n to obtain in each 
case a series of values of £’(p) = A(p) corresponding to closely and equally spaced values of p. 
By backward interpolation exact framework values of p99, were found, and then Lagrangian 
interpolation used to complete the remaining values. The two sets of values of the standard- 
ized error, Po.95 ANd Poo, are given in Table 4 and should not be in error by more than | unit 
in the last figure. 


(6) Computation of standardized error for the case m > 2 


In the generalized form of the u-test the estimate of the population standard error of z is 
made not from a single range, w, but from the mean of m ranges, #(m,n) obtained from m 
independent samples or subgroups, each containing n observations. To simplify the algebraic 
expressions in what follows, this mean range (m,n) is written as w where no confusion is 
involved. 

For a given probability level « and a mean value of x at a distance p > 0 from the origin (the 
standard error of x being taken as the unit), we may write the component /’(p) of the power of 
the u-test as 


B'(p) = i) | Tq oe Pw) de, (8) 
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Table 4. Standardized error of the u-test (m = 1) 
n Po-05 Poon n Po 05 Poon 
2 24-975+ 163-99 12 4-062 6-11 
3 7-807 21-66 13 4-028 6-01 
4 5-713 11-98 14 3-999 5-93 
5 5-000 9-21 15 3-975 — 5°86 
6 4-652 7:98 16 3-954 5-80 
c 4-451 7-30 17 3-936 5-75 — 
8 4-320 6-88 18 3-920 5:70 
9 4-227 6-59 19 3°906 5-66 
10 4-158 6-39 20 3-893 5-62 
ll 4-105— 6-23 co 3-605 — 4-90 


























where the limits of integration satisfy Q <<, 


0<w<a, 

we > uUu 

wid,” 
and where y = p(w) denotes the probability distribution of @ = #(m,n). Unlike equation (7), 
we shall integrate (8) first with respect to x and obtain 
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Similarly, it is easy to show that the second component of the power, £"(p), is a similar 
expression with +, written for —p in the limit of integration. 

In this section, values of the standardized error po, are determined over a range of values 
of m and n. As before, the second component, £"(p), of the power function is zero in the 
region of p = fy; to the limits of accuracy used (five decimal places or more), and we therefore 
have A(p) = A’(p). 

For a series of framework values of m and n, and using numerical values (u,,) of the 5 % 
points of the distribution of u = u(m,n) tabulated previously (Lord, 1947), quadrature was 
applied in each case to equation (8) to obtain a series of values {(p) corresponding to a range 
of narrowly spaced values of p. By backward interpolation py, was then determined as the 
value of p corresponding to £(p) = 0-95. This calculation was carried out to obtain framework 
values corresponding to m = 2, n = 2, 3, 4, 5, 6, 10, 16 and 20; m = 4, n = 2, 3 and 4; and 
m = 8 and n = 2, using values of the ordinate p(w) of the distribution of the mean range 
previously evaluated in the investigation of the u-test cited above. The limiting value for 
Poos for indefinitely large m or indefinitely large n is, as in the preceding section, the limiting 
value of P90; for indefinitely large v in the t-test. 

For m = 2, Lagrangian formulae were used ‘to interpolate the intermediate values of the 
standardized error, taking arguments proportional to 1/n and reciprocals of the corresponding 
standardized error for the variate. As a check, the values were inspected by determining the 
differences up to the second order, and then reduced by one place of decimals. These reduced 
values are given in Table 5, together for convenience with reduced values for m = 1 from 
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Table 4. In the case of n = 2, framework values of py, had been calculated for m = 4 and 
m = 8. Values of poo, were determined for each chosen value of m by Lagrangian interpolation, 
using reciprocals of m for argument and reciprocals of the corresponding values of p.9, as the 
variate, the curve passing through the points corresponding to n = 1, 2, 4, 8 and oo. The 
interpolated values of py9, obtained by this method, and the directly computed values for 
m = 4 and m = 8 are given in Table 5 for a series of values of m suitable for practical use. 
As a check upon the accuracy of this method of interpolation the computation was repeated, 
this time using a four-point Lagrangian passing through points corresponding to m = 1, 2, 4 
and oo. Most of the interpolated four-point values of poo; agree exactly with those obtained 
by five-point interpolation. Where differences occur, none amount to more than either 1 or 
rarely 2 units in the last tabulated figure. The five-point Lagrangian method of interpolation 
therefore appears adequate for furnishing the required degree of accuracy, an error not 
exceeding | unit in the last figure. 

For n = 3 and n = 4 the values of the standardized error ior different values of m are 
appreciably smaller and are nearer to their limiting values than in the case of n = 2. In view 
of the agreement between the four-point and five-point Lagrangian interpolated values of 
Poos for n = 2, a four-point Lagrangian through points corresponding to m = 1, 2, 4 and 00 is 
adequate for interpolation of p99; for these further two values of n. 

As a further check upon the validity of the above method, the values of po; form = 4 were 
also interpolated for the chosen range of values of m, using a three-point Lagrangian curve 
through points corresponding to m = 1, 2 and oo. This yielded interpolated values in exact 
agreement (to the number of figures given) with the four-point values in Table 5. The 
accuracy of the three-point Lagrangian will certainly be no less for interpolating within the 
field of the less rapidly changing values of py9;. It was applied in the case of values of n from 
5 to 20 to obtain interpolated values of the standardized error corresponding to the chosen 


range of values of m, aad the results, after reduction to two decimal places, are given in 
Table 5. 


4. EFFECT OF GROUPING IN THE U-TEST 


The case when the estimate of standard error of x is obtained from the mean of m ranges of n 
random values, instead of a single range, has been investigated for the « = 0-05 probability 
level by the determination of the standardized error py9;,. Reference to Table 5 shows that for 
a sample containing, say, N = mn observations the standardized error is not constant but 
varies slightly for the different possible combinations of m and n. For example, taking 
N = 16 we have the following values of p.,: 4°20 for m = 8 and n = 2; 3-96 for m = n = 4; 
3°92 for m = 2 and n = 8; and 3-95 for m = 1 and n = 16. 

The variation in the values of 9.9, is more pronounced for small samples than for large 
samples. For N = 10, poo; falls from the value 4-68, corresponding to m = 5 and n = 2, to 
4-16 when the estimate of standard deviation is determined from the total range of values, 
ie. when m = 1 and n = N = 10. For larger samples py, fa’!s from a maximum at n = 2 to 
a minimum for a particular combination of m and n, and then increases again as n approaches 
the sample size N. When the size of the sample is such that it may be divided in several ways 
into random subgroups of different size n, the greatest power of discrimination corresponding 
to the minimum standardized error occurs when 7: = 8. As would be expected, it can easily 
be shown that this size of subgroup also gives the most efficient mean-range estimate of 
standard deviation of indefinitely large samples. More particularly, comparison of the values 
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of P9.9;in Table 5 with the corresponding figures fcr the standard error of mean-range estimates 
of standard deviation of samples of finite size N = mn, indicates that the grouping combina- 
tion giving the greatest power of discrimination in the w-test is the same as that yielding the 
most accurate estimates of standard deviation. 

The loss of power of the u-test, attendant upon the use of a number of subgroups of very 
s.nall size, is caused primarily because we ignore the variation between the subgroups in 
forming an estimate of the variate standard error. A similar loss of power also arises in the 
application of the usual t-test, if the estimate of standard deviation is determined from the 
variation in subgroups of a sample of total size N. Here the loss is represented by a reduction 
in the degrees of freedom of the estimate of variance, from N —1 to N —m. 

If N be a prime number, it is still preferable to divide the sample into subgroups for esti- 
mating the standard deviation by mean range. The theory indicates that however large J, 
the u-test is nearly as powerful as the t-test. Nevertheless, in practice it is advisable not to 
overlook the possibility that the variate does not exactly follow the normal law, particularly 
at the tails of the distribution where the extreme individuals from large samples will fall. 
Again, N may not be prime but contain only one low factor or only large factors. If all the 
observations were used, the estimate of standard deviation would be determined from the 
mean rarige in either a large number of very small subgroups (of size, say, m = 2 or 3) or a 
small number of very large subgroups. In both instances, it is generally advisable to ignore 
a few observations and divide the major portion of the sample into random subgroups of 
equal size. Two illustrative examples bearing on these points are given below. 

Suppose we wish to determine whether the mean (%) of a sample of 19 values is consistent 
with the parent population having some hypothetical mean value ¢. To test this null 
hypothesis we could determine the ratio 

1 — [Bel dae V9) 
W49 

With wu based on the total range, m = 1 and n = 19, Table 5 gives poo, = 3-91. A slightly 
greater degree of accuracy would result from the use of an estimate of standard deviation 
based on m = 2 ranges of n = 9 random values, for which po, = 3-89. It is of course essential 
that the choice of the groupings of 9 should be random. If the order of occurrence of the 
observations is known to be independent of their magnitude, as frequently happens in 
practice, we would probably accept the first nine numbers to form one group, the 10th to the 
18th as the second group, and ignore the 19th in determining the range estimate of standard 
deviation. The ignored value is, of course, included with the others in comp ting the sample 
mean %, and the corresponding u would be | Z—& | d, ./(19)/w(2, 9). 

As a further illustration of the effect of grouping, we shall consider the case when the mean 
(Z,) of a sample of say 34 values is to be compared with the mean (%,) of a second sample 
containing 51 values. We could estimate the standard error of the difference between 7%, and %, 
from the mean (5,17) of 5 ranges, each of 17 values, i.e. using 2 random subgroups of 17 


values from the first sample and 3 random subgroups of 17 from the second. The value of u 
would be 





et | zy mei Xo | dy, 

w(5, 17) J(ge+ ex)’ 
and its statistical significance could be gauged by comparing its value with tabulated per- 
centage points of u(5, 17). From Table 5, the corresponding standardized error of the u-test 
for m = 5 and n = 17 is 3-67. Alternatively, we might estimate the standard error of the 
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difference from the mean of m = 8 ranges of n = 10 values, 3 ranges from the first sample 
(with 4 values discarded at random) and 5 ranges from the second (1 value discarded at 
random). The appropriate equation for wu would then be 
ome | % — 2» | dy 
(8, 10) (4+) 

By varying the size of subgroups and discarding a few odd values, several other combinations 
are feasible. The table below contains some combinations which might possibly be chosen in 
practice with these data, and gives the staadardized error p99, when the range estimate of 
standard deviation is based on m, ranges of n values from the first sample and m, from the 
second. (Values of the standardized error are given to 3 decimal places, calculated from the 
original values of Table 5 before reduction to 2 decimals. These interpolated values may be in 
error by 1, less likely by 2, units in the last place.) It will be seen that the efficiency of the 
test, as measured by fy.9;, scarcely differs throughout the range of n considered. 
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Table 5 may be used in cases such as those above, to determine quickly the grouping 
combination which will give the greatest accuracy in application of the u-test. Generally, it 
would appear from Table 5 that samples of size N > 13 should be divided into subgroups of 
equal size and the estimate of standard error made from the mean range within the subgroups. 
Where possible, the size of the subgroups should be n = 8, in any case not greater than 
n = 10 nor less than n = 6. The division of a whole sample in this way may entail discarding 
a few ‘surplus’ observations in determining a mean range, but these are not excluded from 
the sample mean. When, as above, the sample may be divided in several ways in subgroups of 
size from 6 to 10, the choice of any one in preference to another will certainly not lead to any 
appreciabie loss of accuracy. 


5. POWER COMPARISON OF t- AND U-TESTS 


A comparison of Tables 1 and 3 shows the relative efficiency of the symmetrical t- and u-tests 
in establishing significance at the 5 % probability level, in the case where the range estimate 
of o is derived from a single group of n observations. It is clear that while for a given value of 
p = &/o the t-test is always the more powerful, the difference is barely appreciable for many 
practical purposes. 

The power of discrimination of the two tests may also be compared in terms of the standard- 
ized errors Poo; aNd Poo; given in Tables 3 and 4. Table 6 shows the ratio of the standardized 
error of the u-test to that of the t-test. The maximum value of this ratio for py; is seen to be 
1-024, This, .or example, means that with a sample of n = 16, whereas the odds are 19 to 1 on 
establishing significance at the 5 % level with the t-test if there is a shift in population mean 
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of + 3-8620/,/(16) = + 0-96550 from the value specified by the null hypothesis, the shift must 
be nearly 2} % greater for it to be detected with the same odds if o is estimated from the range. 
If the 1 % level is used, and odds of 99 to 1 on establishing significance are taken, a 44 % 
greater shift in mean is needed with the u-test than with the t-test. 

Standardized errors are particularly applicable to study of the w-test when the estimate of 
standard error of the variate is based upon the mean of ranges within random subgroups of 
equal size. For example, suppose we have a single sample of n = 20 and wish to establish 
whether the population mean has a specified value. With the t-test for vy = 19 degrees of 
freedom, Table 2 gives fo, = 3-804. With the w-test and using the total range in the 20 values, 
Table 4 gives poo, = 3893. Correspondingly, the ratio 3-893/3-804 = 1-023 as noted in 
Table 6. If in place of the total range the mean of two ranges of 10 values be used in the 
u-test, Table 5 gives 3-86 for py;. This latter value is not quite 2 % greater than fo, for the 
t-test and is slightly less than the value arising from the total range. 


Table 6. Ratios of standardized errors of u- and t-tests 














tatio of standardized errors Ratio of standardized errors 
n n 
0-05 0-01 0-05 0-01 
2 1-000 1-000 12 1-023 1-045 — 
3 1-005 — 1-008 13 1-023 1-045 + 
4 1-010 1-018 14 1-024 1-045 + 
5 1-015 — 1-028 15 1-024 1-045 — 
6 1-017 1-033 16 1-024 1-045 — 
7 1-019 1-036 17 1-024 1-044 
8 1-021 1-039 18 1-024 1-043 
9 1-022 1-041 19 1-024 1-043 
10 1-022 1-043 20 1-023 1-042 
11 1-023 1-044 ree) 1-000 1-000 


























As a further illustration of this method of comparing the tests, we may consider the testing 
of the statistical significance of the difference between the observed mean values of two 
samples, each of size, say, n = 30. From Table 2, use of the t-test on the 5 % probability level 
is seen to give a standardized error of about 3-66 (v = 58 degrees of freedom). With the w-test, 
if each sample be divided into, say, 3 subgroups of 10 values and the mean of the 6 ranges be 
used to estimate the standard error of the observed difference, reference to Table 5 gives 
Poos = 3°68. This value differs from the t-test value of 3-66 by less than 1 %. 

The foregoing investigations appear to justify previous claims made for the use of range in 
place of root-mean-square estimates of standard deviation in an analogue of the usual t-test. 
For most practical purposes the loss in power accompanying the use of the range is negligible 
and, indeed, is generally compensated by the appreciably simpier and quicker method of its 
application in a wide range of problems frequently arising in both routine testing and investi- 
gational work. 
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THE USE OF MEAN RANGE AS AN ESTIMATOR OF VARIANCE 
IN STATISTICAL TESTS 


By P. B. PATNAIK 


1. INTRODUCTION 


The distribution of the range in random samples from a normal population has been studied 
numerically by ‘Tippett (1925) and Pearson (1926, 1932). McKay & Pearson (1933) have 
obtained the general expression for the distribution. Hartley (1942) determined a simpler 
expression for the probability integral and with Pearson (1942) tabulated this for samples 
of size n = 2 to 20. 

Only the first two moments of the range* have so far been fully calculated and are available 
numerically (Table A, Pearson, 1932), although values of (,, £, are known exactly for up 
to 6 and, approximately, after 6 (Pearson, 1926, p. 192). It is possible, however, to compute 
tables of the exact moments from those of the probability integral by quadrature.t 

The use of the range in place of the root-mean-square estimate of the population standard 
deviation has become important in several fields, particularly in quality control. Although 
the range furnishes a less efficient estimate, its simplicity and ease of application in routine 
work, such as production-line inspection, makes it an important statistic in practice. 

It is known that the distribution of the range in normal samples depends on the sample 
size n, is independent of the population mean, but dependent on its standard deviation, o. 
Moreover, for large n (say n > 20), even small departures from normality in the tails of the 
parental distribution have a considerable effect on the distribution of range. Furthermore, 
the relative efficiency of the range as an estimator of o decreases as n increases. Hence, in 
practice, when 7 exceeds say 12, it is preferable to divide the sample into a number of groups 
and take a weighted mean of the several group ranges. The question of the subdivision which 
will give the smallest variance of the estimate has been considered by Pearson (1932) and by 
Grubbs & Weaver (1947). It is found that groups of seven or eight are the best. It will 
generally be advantageous to have equal groups of about this size and use the average of the 
group ranges, viz. the mean range. 

The exact distribution of mean range cannot be obtained in a simple form, except in the 
trivial case of two samples of two observations in each. We shall, however, obtain an approxi- 
mation to the distribution and, from this, derive the distribution of the ratio of a normal 
variate to mean range and compare it with the results of Lord (1947), who has studied the 
position numerically. We will also find an approximate distribution of the ratio of an in- 
dividual range to mean range. These distributions will be used to obtain certain statistical 


tests. 
2. APPROXIMATION TO THE DISTRIBUTION OF MEAN RANGE 


Denote by 2, 2%», ...,%, a random sample of n observations, arranged in ascending order of 
magnitude, drawn from a normal population having mean uv and standard deviation o. Then 
the range in this sample is denoted by 

Wy = Ly —2y. 


* ‘Range’ will denote, throughout, the distance between the highest and the lowest observation in 
a sample randomly selected from a normal population. 
+ [Calculations, for sample sizes up to 20, have now been completed. Ep.] 
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If there are m such independent samples, with n observations in each, the mean of the m 
ranges will then be denoted by w,, ,.. 

Suppose the mean and variance of w,, are written as od, and var (w,,). Then the mean and 
variance of the distribution of w,, ,,/o are given by 


E (Wn n/7) =d, = M, say, 
(1) 


1 
var (Wn, n/7) = mot Vor (w,)= V, say. 


Hence we see that ¥,, ,,/d,, gives an unbiased estimate of o. 

Pearson (1926, p. 191) has given a diagram showing the /,, /, points of the distribution 
of w,,. If the sample contains less than about twelve observations, these points lie in the 
Type I area and not far from the Type ITI line; the /,, £, points for the mean range, ©, ,,, 
will lie in the same area, but closer to the normal point, £, = 0, #, = 3. Since the f,, /, 
points for the distribution of y fall in the same region and converge, as the degrees of freedom 
increase, on the normal point, it seems likely that a y-distribution will give a reasonably 
accurate representation of the distribution of w,, ,. 

Identifying the first two moments, M and JV, of #,, ,,/o with those of cx/,/v, where x has 
v degrees of freedom, we obtain the following relations: 


w= per )/ 9) 


r-S-9 E/T] 


Expanding the I'-functions by Stirling’s formula, we find 
1 1 5 
M=(1- Ft aotigat), (2) 
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from which follows the equation 


V ] 1 1 


‘=> ots leet (4) 


i.e. 


Retaining the first two terms on the right-hand side of (4) and solving the resulting quadratic, 
we have ify zs —242 (14 2k). 
A further approximation, using the term in 1/(v*) gives 
1/y = —24+2 (1+ 2)), (5) 

where j = k+1/(16y*) = V/M*+1/(16y), the first approximation to v being used in the 
second term. The corresponding expression for c, to the same order of approximation as 
v in (5), is / 

? : 1 5 
em M {1+ 5+ on~Taea) 6) 
in which M can be replaced by d,,. 
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Thus we can represent the distribution of @,, ,/(co7) by that of x/,/v. Since s/o follows the 
distribution of x/./v, s being the sample root-mean-square estimate of 7 based on v degrees 
of freedom, it follows that %,, ,, is distributed approximately as cs. 

From the mean and standard deviation of range given in Pearson’s Table A (1932), the 
values of M and V in (1) are known, and using these in (5), v is obtained and then c from (6). 
We give here (Table 1) a short table of d,,, v and c for n = 3 to 10, m = 1 to 5. 


Table 1. Values of d,, v and c for the x approximation to Wp,» 




















No. of samples 
Size — 
of d, m=1 m= 2 m=3 m=4 m= 5 
sample 
n 
v c v c v c v c v c 

3 1-692 1-934 | 1-9164 3-850 | 1-8049 5-674 | 1-7684 7-499 | 1-7498 9-312 | 1-7385 
4 2-0588 | 2-951 | 2-2374 5-705 | 2-1505 8-450 | 2:1204 | 11-191 | 2-1052 | 13-931 | 2-0960 
5 2-3259 | 3-828 | 2-4812 7-474 | 2-4048 | 11-107 | 2:3788 | 14-732 | 2-3657 | 18-355 | 2-3578 
6 2-5344 | 4-692 | 26721 | 9-169 | 2-6001 | 13-641 | 2-5812 | 18-109 | 2-5696 | 22-576 | 2-5626 
7 2-7044 | 5-499 | 2:8295 | 10-779 | 2-7677 | 16-052 | 2-7468 | 21-324 | 2-7362 | 26-596 | 2-7299 
8 2-8472 | 6-259 | 2-9630 | 12-297 | 2-9056 | 18-328 | 2°8850 | 24-358 | 2-8768 | 30-386 | 2-8707 
9 2-9700 | 6-989 | 3-0778 | 13-753 | 3-0245 | 20-511 | 3-0064 | 27-270 | 2-9974 | 34-025 | 2-9920 

10 3-0775 | 7-689 | 3-1789 | 15-151 | 3-1287 | 22-609 | 31117 | 30-066 | 3-1032 | 37-523 | 3-098) 












































N.B. W,,,/¢ is distributed approximately as cx/,/v, where c is a scale factor and v a fractional degree of 
freedom. 


Unfortunately, there is at present no direct means of judging the accuracy of the above 
approximation. When the exact moments of w,, above the second are computed, it will be 
possible to derive the higher moments of w,, ,, and so compare them with the moments of 
our approximate s-distribution. The probability integral and percentage points of the 
distribution of @,, ,, can be obtained approximately from those of the x and hence from those 
of the y®-distribution with degrees of freedom given by the v of equation (5). 

Turning to Table 1, we note the way in which c tends to d,, from above as n increases; 
further, we see that the equivalent, ‘fractional’ degrees of freedom, v, of the approximation 
are always rather less than m(n—1), the figure appropriate were we to estimate o from the 
within-group sums of squares. 


3. DISTRIBUTION OF z/W 


Let x be a variate distributed normally with mean zero and standard deviation o, and let 
8 be an independent root-mean-square estimate of 7 based on v degrees of freedom. In §2 
it was seen that the mean range could be used for estimating o. Therefore in parallel with 


the ratio t, we may take the ratio ‘ 


~ wid,” % 
where @ stands for W,, ,* and d,,o is the expectation of the range in samples of n. 

Lord (1947, 1950) has considered this distribution and developed the ‘u-test’, giving 
several of its applications. A wide range of tables of percentage points have been computed 


U 


* In the rest of this section @ will be used for ,,, ,. 
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by him by methods of quadrature and interpolation. Daly (1946) also deals with this test, 
but he takes a single range instead of the mean range. 

We will now employ the approximate distribution of # obtained in § 2 to derive an approxi- 
mation to the distribution of wu. Since # is represented by cs, we see that the distribution of 
u can be approximated by that of 

“u=—= = t, (8) 


where t is based on v degrees of freedom, c and v being given by equations (5) and (6). In other 
words, w{1 + 1/(4v) + 1/(32v*) — 5/(128v%)} is distributed approximately as ‘Student’s’ ¢ with 
degrees of freedom v given by equation (5). It is therefore possible to find approximate 
percentage points for « by interpolating for a fractional v in any table of the percentage 
points of ¢. Using this method, we have calculated the percentage points of the distribution 
for significance levels* « = 0-10, 0-05, 0-02 and 0-01 for several values of n and m. They are 
shown in Table 2, and Lord’s values are given alongside for comyarison. The good agreement, 
even for low values of « and for m = 1, i.e. for a single range, suggests that the distribution 
of u is closely approximated by that of d,,t/c. We may also infer that the y-approximation 
to the distribution of w is fairly good. 


Table 2. Values of tiie percentage points of the distribution of u = d,x/W», » 



































Size No. a=0-10 | a = 0-05 a = 0-02 a=0-01 
of of ahaa 
sample | samples | 

n m Approx.*} Lordt |Approx.*| Lordt |Approx.*| Lordt |Approx.*} Lordt 

5 1 2-02 2-02 2-64 2-63 3°58 3-56 4-39 4-38 

3 1-75 1-75 2-15 2-15 2-65 2-65 3-03 3°02 

5 1-71 1-71 2-07 2:07 2-51 2-51 2-83 2-83 

10 1-68 1-68 2-01 2-01 2-42 2-42 2-70 2-70 

8 l 1-85 1-85 2-33 2-32 298 | 2-95 3-50 3-45 

3 1-71 1-71 2-07 2-07 2-51 2-51 2-83 2-83 

5 1-68 1-68 2-03 2-02 2:44 | 2-43 2-73 2-72 

10 1-66 1-66 1-99 1-99 2-38 +38 2-65 2-65 

| 10 1 1-81 1-81 2-25 2-24 2-83 2:81 | 3-29 3-24 
3 1-70 1-70 2-05 2:05 | 2-48 2-47 | 279 2-78 
5 1-68 1-68 2-01 201 | 2-41 2-41 2-70 2-69 

10 1-66 1-66 1-99 1:98 | 2:38 2-37 2°64 2-63 
































* Computed from the t-approximation suggested above. 
+ Computed by Lord, using numerical quadrature. 


To test for the significance of (a) the difference between the mean of a sample, %, and a 
pre-assigned value of a population mean, yj, (b) the difference between two sample means 
Z,, Z,, we can form test criteria using the mean range of the observations in the sample or 
samples concerned. It is known that the sample mean is statistically independent of the 
range in the sample. The mean Z is, therefore, also independent of the mean range w of the 
subgroups of the samples. ; 

* We have considered here the double-tailed test, rejecting the null hypothesis if |t]>t,,, where 
P{|t| >t} = a. 
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In case (a), if the sample of N can be divided randomly into m subsamples of n observations 
each,* then we form the ratio é' Be 
cu _ oN (%-x) 


= 
dy Wm, n 


(9) 
which will be distributed as ¢ in virtue of (8), with v degrees of freedom. In case (6), if the two 
samples of sizes N,, N, can be randomly divided into m,, m, subsamples of size n,* then the 
mean of the k = m, +m, ranges is taken and the statistic 


Fe ee c(%, — Z,) 
When V(1/N, + 1/Np) 


follows the distribution of ¢ with v degrees of freedom. Thus in both cases we refer v to the 
t-probability scale. v and c are given by equations (5) and (6), and in certain cases their values 
may be taken from Table 1. We shall illustrate the procedure by an example. 

E....nple 1. Consider the data of Example 5 given by Lord (1947, p. 60). The mean strength 
(in lb.) of cotton yarn in two samples, A (with N, = 30) and B (with N, = 20), and the ranges 
of the five subsamples, of ten observations each, are: 





(10) 


Sample A Sample B 
Mean 28-90 27-40 
Range 3-0, 5-0, 5-0 4-0, 3-5 


Hence, mean range, W; 4) = 4:1, difference of means Z, —%, = 1-5. 

From Table 1, c = 3-098, v = 37-52. The computed value of v in (10) is 3-926. This falls 
beyond the 0-1 % point for t, which for v = 37-52 is at about 3-6, and therefore the difference 
in strength of the two batches of yarn is certainly significant. 

The value of ‘Student’s’ ¢ for the data of this example was found to be 3-7, which again 
exceeds the 0-1 % point of t for 48 degrees of freedom. 


4, DISTRIBUTION OF W/w 


Suppose Wy is the range in a sample of N observations from a normal population with mean 
and standard deviation o. Let there be m further independent samples of n drawn from the 
same population, and let the mean of their ranges be w,, ,. Using the s-approximation to 
the distribution of # obtained in § 2, it follows that the ratio 
cWy 
I-F., (11) 
will be distributed approximately as the ratio of (a) a range in a sample of N observations, 
to (6) an independent root-mean-square estimate of o based on v degrees of freedom, where 
v and ¢ are given by equations (5) and (6). This ratio is the so-called ‘Studentized’ range, 
q = Wy/s, the probability integral and percentage points of which have been tabled by 
Pearson & Hartley (1942).f 
The accuracy of the above approximation to the range ratio W/w could only be judged 
when the exact percentage points are computed by methods similar to those used for d,,x/w. 


* In the preceding paper, Lord (1950) has shown that it may be worth while omitting a few obser- 
vations in the estimation of o, in order to ensure the breaking up of the remainder into appropriate 
equal groups. 

t Note that the n of their tables corresponds to our N. 
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However, Hartley’s lemma (1948) tells us that the maximum errer in the probability integral 
of W/w will be less than the maximum error in the probability integral of #, which may be 
fairly small judging from the agreement in the percentage points of d,, x/W. 

It may be noted that it would have been possible to employ the s-approximation for Wy 
as well as for #,, ,, and so regard the square of the ratio W/w (when multiplied by the appro- 
priate constant) as equivalent to a variance ratio, F. But as Wy is a single range, not a mean 
range, it seems probable that the ‘Studentized’ range approximation will be the more 
accurate. 


5. APPLICATION OF THE DISTRIBUTION OF W/W TO THE ANALYSIS OF VARIANCE 


Using the range-ratio, W/W, we can formulate a test of significance, analogous to the F-test, 
applicable to analysis of variance. We shall consider a one-way classification where there are 
m groups with n observations in each. 

Whether the systematic set-up* or the random set-up is relevant, if the null hypothesis 
is true, the observed group means are distributed normally with variance = o3/n, where of 
is the residual variance within the groups. 

If W,, is the range of the group means and ¥,, ,, the mean of the m group ranges, it can be 
shown that these two quantities are statistically independent. Hence, using our approxi- 
mation for %,,,, the ratio g = cW,,/,,, is approximately distributed as W,,/s, where s is 
independent of W,,. Now W,, is ‘Studentized’ when it is divided by s/./n, the estimate of 
g,|/n. Hence c ./n W,,/W, » is a ‘Studentized’ range of a sample of size m and with degrees 
of freedom v. 

Thus the ‘range-test’ for the hypothesis of no variability between groups consists in 
evaluating 





g=—™e Jn, (12) 
mn 


w 
and testing whether or not it exceeds the 100a % point of the ‘Studentized’ range for m 
and v. The procedure may best be illustrated by an example. 

Example 2. The following table gives the yield of grain in bushels per acre, corresponding 
to seven varieties (Weatherburn, 1947, p. 213): 











V; V; V; VY, V; V, V, 
13 15 14 14 17 15 16 
ll 11 10 10 15 9 12 
10 13 12 15 14 13 13 
16 18 13 17 19 14 15 
12 12 ll 10 12 10 ll 
Means 12-4 13-8 12-0 13-2 15-4 12-2 13-4 
Ranges 5 7 4 7 7 6 5 
































* The distinction between the systematic and random set-ups has been described by a» number of 
authors; see, for example, Daniels (1939), Johnson (1948) and Patnaik (1949, p. 225). 


6-2 











84 The use of mean range in statistical tests 
We find W,=34, w,,=4. 


Further M = d, = 2-32593 and, from Pearson’s Table A (1932, p. 416), the variance of 
w;/o is (0-8641)?. Hence, from equation (1), V = (0-8641)?/7 = 0-10667. Introducing these 
values into equations (5) and (6), we find 
v = 25°61, c= 2-349. 

Finally, from (12) we have g = 3-049. This value is considerably below the upper 5 % limit 
for g given in Pearson & Hartley’s tables, for m = 7, v = 25-61, viz. 4-53. The data, therefore, 
do not suggest the existence of significant differences in the variety yields. 

By the ordinary analysis of variance, the ratio of the mean square between varieties to 
that within varieties is found to be 1-1, while the F,,; for v, = 6, v, = 28 is 2-45. Thus the 
range test leads to the same conclusion as the F-test. 


6. THE POWER OF THE U, OR RANGE, TEST 


The ratio wu, of equation (7), may clearly be used as an alternative to ¢ in tests of significance. 
Using our method of approximation, we shall now examine to what extent wu is less efficient 
than ¢ in detecting true differences in mean values. This may be done by deriving the power 
function of the u-test and comparing it with that. of the t-test. In his second paper, Lord 
(1950) has made an exact comparison, using methods of quadrature; in what follows we shall 
apply a more approximate method, based on an adaptation of the non-central t-distribution. 

In (7), x was assumed to have a mean, = 0. Ifin fact &(x) = ~+0, then wu can be written 


in the form * (z—p)lo+pulo  z+plo 


wi(d,7) = W/(d,o)’ 





where &(z) = 0 and var(z) = 1. The ratio will follow what may be termed a non-central 
u-distribution. If now we use the cs approximation to @ derived in § 2, it is seen that u may 
be written as 








d,2+phlo 
c slo 
/ 
or, expressed in another way, = = - ais. og (13) 
n 


It follows from (13) that (a) if ~ = 0, cx/@ is distributed as t with v degrees of freedom; 
(6) if w+ 0, it is distributed as non-central ¢ with v degrees of freedom and displacement /c. 
c and v will be given as before by equations (5) and (6). Thus the power function of Lord’s 
u-test may be obtained, to the degree of approximation involved, from the power function 
of ‘Student’s’ t-test, using the appropriate fractional degrees of freedom for v. 

Tables of the power of the t-test have been given by Neyman (1935). They are for the 
asymmetrical comparison, i.e. the case where we reject the null hypothesis if t>t,, where 
P{t>t,} = «. Suppose that the estimate of variance is to be based on m groups of n obser- 
vations; then using ‘Student’s’ test, we shall have an estimate of 7? based on m(n — 1) degrees 
of freedom, while the equivalent degrees of freedom for Lord’s test will be the fractional v 
derived from equation (5) or, where possible, from our Table 1. Some comparisons of the 
two tests are made in Table 3 below, for displacements y/o = 1, 2 and 3. 

As we should expect, since v < m(n — 1) the power of the w-test to detect departures from 
the null hypothesis, ~ = 0, is always less than that of the t-test, but it is clear that, for the 
cases chosen, the differences in power are remarkably small. 
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Table 3. Power functions of the u- and t-tests 
(Single-tailed test, with « = 0-05) 

















Values of w/o 
Size No. 
of of 
sample | samples 3 8 

n m 

u-test t-test u-test t-test u-test t-test 

5 3 0-240 0-242 0-592 0-595 0-879 0-881 

5 0-248 0-249 0-611 0-613 0-893 0-895 

10 3 0-250 0-252 0-616 0-620 0-897 0-900 

5 0-253 0-254 0-623 0-624 0-901 0-902 
































It is necessary, of course, to consider what is the accuracy of the approximation to the 
non-central u-distribution. Since this paper was completed, Mr Lord has kindly put at my 
disposal his tables of computed values of the exact power function and the ‘standardized 
error’ of his test. His calculations are for the symmetrical or double-tailed test; here, we 
reject the null hypothesis if | t| >t, where P{|¢|>t,,} = «. 

The following comparisons have been made: 


(a) Casem =1,n=10 


Table 1 above shows that, for the approximation, v = 7-689. Interpolating with this 
fractional value in Lord’s Table 1 of the power function of ‘Student’s’ ¢ (p. 67 above), 
we get the approximate values of the power shown below for ~/o = 2, 3 and 4. These are 
compared with the true values, taken from Lord’s Table 3 (p. 70 above). 


Power of double-tailed tests, with a significance level, a = 0-05 








Bio 2 3 4 
u-test: Approximation 0-417 0-743 0-934 
True value 0-421 0-747 0-935 
t-test: 9 degrees of freedom 0-431 0-761 0-944 




















In this case, with m = 1, the approximation was not expected to be very good. Let us 
make comparisons for m>1. Here Lord gives only the standardized errors, that is to say, 
the values of p = y/o for which the power equals 1 — «. Thus pg; is the value of «/o for which 
there is a 0-95 chance of establishing significance, using the test at the 5 % level. 


(6) Case m = 2,n = 10 


Table 1 shows, for our approximation, that v = 15-151. Using this value to interpolate 
in Lord’s Table 2, it is found that py; = 3-86. The true value given by Lord in his Table 5 is 
also 3-86. 
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(c) Casem=4,n=5 

For the approximation, vy = 14-732 and hence from Lord’s Table 2 (p. 68), P99; = 3°87, 
again agreeing to the second decimal place with the true value in his Table 5. 
(d) Casem=5,n=3 

For the approximation, v = 9-312, giving ppo, = 4:05, agreeing with Lord’s computed 
value. 
(e) Case m = 2,n=5 

For the approximation, v = 7-474, giving py9, = 4:19, against Lord’s value of 4-18. 


There seems little doubt that, if a mean range can be used to estimate o, the approximation 
will be very good. 


7. THE POWER OF THE TEST BASED ON THE RATIO OF RANGES, W/w 


Turning now to the range-ratio test in the analysis of variance considered in §§ 4 and 5, 
we have to distinguish between the two set-ups—the random and the systematic—for 
considerations of power. Let us take the former and the simple case of m groups with n 
observations in each. If, as before, o? is the variance between the groups and o? the variance 
within the groups, the observed group means will have a variance of o? + 03/n. With the 
usual notation, when o? +0, g = cW/w is approximately distributed as 


Ja) 
w i "a W 





= yn q; 
where q is the ‘Studentized’ range of a sample of size m and with v degrees of freedom. 
Hence the power of the g-test based on W/w, to detect the presence of between-group 
variability measured in terms of o*/a3, can be obtained using the Pearson & Hartley (1942) 
table of the probability integral of q. 

This result could be compared with the power of the analysis of variance F-test under the 
random set-up (see Johnson, 1948). 

On the other hand, if the systematic set-up is valic. then the alternative hypothesis states 
that the m group means have different expectations, but have the same variance o3/n. Now, 
their range W is what may be termed a non-central range, and so W/W will be distributed as 
the ratio of a non-central range to the average of m central ranges. The distribution function 
of non-central range is found to be the sum of a number of multiple integrals, and except in 
the case of sample size of 2 and 3 is extremely complicated. The distribution of the ratio of 
non-centrail range to mean-central range is not easy to handle even with our approximations. 


~ + Veh = OOOO, 


a 
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nd 5, 

—for [Editorial Note. Since this paper was accepted for publication, a paper has been published 

thn by D. R. Cox (J. Roy. Statist. Soc., Series B, 1949, pp. 101-114), in which the distribution 

ance of range is approximated to by using a y? (or I’) distribution with the correct first two 

1 the moments. This method is distinct from that of Patnaik, who uses the distribution of y. 
When testing whether two variances are equal, Cox’s approach leads to the ratio of two 
ranges or mean ranges being distributed as F', whereas Patnaik’s approach leads to the use 

} of the tables of percentage points of ‘Studentized’ range. Cox is mainly concerned with 

applications in problems of sequential analysis. ] 
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SOME NOTES ON THE USE OF RANGE 
By E. 8S. PEARSON 


1. The preceding papers by Lord and Patnaik carry a stage further the long series of 
investigations by various authors into the use of range in place of standard deviation as 
a measure of dispersion. Lord’s (1947) tables of percentage levels of u (the ratio of a normal 
deviate to an independent range estimate of its standard error), made available a rapid 
means of (a) testing the significance of differences, (b) assigning a confidence interval to a 
mean value, using u in place of ‘Student’s’ t, provided of course that: the population sampled 
is of normal form. Lord and Patnaik’s present papers, together with certain American 
contributions, make it possible to determine just what we lose by employing the less efficient 
estimator in problems of the type (a). Whether this loss of efficiency matters or not depends 
to a large extent on how we look at things. An illustration based on Lord’s tables may help 
to make this clear. 

2. If we estimate the standard deviation from a single group of observations (m= 1), 
we find (Tables 1 and 3, pp. 67 and 70 above) that for|p = plo = 4-0: 

using t, chance of establishing significance at 5% ievel = 0-95822 ifn = v+1 = 14, 

Ses u, chance of establishing significance at 5% level = 0-95824 ifn = 19. 

Thus if ~ = 4-00, a sample of 14 will suffice, using the t-test, to give the same power as a 
sample of 19 using the u-test; it could therefore be argued that in employing the second method 
of analysis we are wasting five observations. However, if the data consist of a sample of 
fourteen observations, then the power of the two tests is as follows: 








| 
p=zshl/e 1 2 3 a 5 
Using ¢ 0-151 0-457 0-792 0-958 0-996 
Using u 0-148 0-444 0-776 0-950 0-994 




















If reduction in calculation time were an asset, the difference in test sensitivity represented 
by the two series of figures would scarcely be regarded as of practical importance. 

3. Nevertheless, in spite of the fact that, as far as the mathematical model takes us, there 
is little to choose between the significance.tests based on the root-mean-square and the range 
estimates of standard deviation, even when m = 1 and the sample size n becomes large, the 
statistician almost instinctively may hesitate to use an estimator depending directly on the 
numerical values of only 2 out of n observations. This is particularly so when n becomes large 
and the two observations are forced out into the tails of the distribution. It seems important to 
try to analyse the source of this hesitation; two objections to the use of range appear worth 
some further discussion. They are that: 

(a) The population distribution may not be normal and this will affect the distribution 
of uw more than that of t. 

(b) The sample may include one or more ‘rogue’ observations* which will upset the range 
more than the root-mean-square estimate of o. 

* By this I mean an observation probably divergent from the mean as a result of some inaccuracy 


of measurement or record or of a disturbing factor which must be regarded as foreign to the system of 
causes producing the normal variability within the population. 
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EFFECT OF DEPARTURE FROM NORMALITY 


4. In the case of the t-distribution, experimental and theoretical investigations (e.g. 
Pearson, 1929; Geary, 1947; Gayen, 1949; Ghurye, 1949) have shown that moderate 
increases or decreases in kurtosis (i.e. 8. > 3 or <3, but £, = 0) have very little effect on the 
significance points, either for the symmetrical or asymmetrical form of test.* The presence 
of positive skewness in the population distribution, however, pushes out the lower signi- 
ficance point and pulls in the upper point (and the reverse for negative skewness), thus 
affecting the asymmetrical test. But, even here, the errors involved tend very nearly to 
cancel out if the symmetrical test is used with the normal-theory significance levels. 

5. We have no direct knowledge at present as to the effect of non-normality on uw. Clearly 
we should anticipate trouble if the expectation of the range estimator, namely, &(w,/d,), 
ceased to equal o and, to a lesser extent, if 7, departed very far from its corresponding normal 
value. In the case of the root-mean-square estimator, although &(s) will no longer equal its 
normal value, namely, 

‘ 6(e) = —X2PG) 


vn—1)0(">) 


the error involved from this cause should not be large, since &(s?) = oa? for all populations. 
6. Some light is thrown on the limiting problem for large samples by considering the first 

two moments of the sampling distribution of a ratio. If r = (w~+<x)/(y+y), where x and y 

are uncorrelated deviates having expectations of zero and standard deviations ¢,, ,, 


then to order n-!, 





o, (1) 


H(, .% 
E(r = 2 (143+...) 2) 
(r) 0 n? ( ) 


h\? (02 o2 
ot = (4) (73452...) 3 
mn) \we 4? - 


When dealing with the u-test, y + 7 is the range estimator of 7, and provided this is unbiased, 
so that 7 = o,, we shall have Pp 
E(u) = — (1+ %y+.-.), (4) 
zx 


2 u\* 

c= 1+(4) Ua, + ..05 (5) 
o, 

where v,, is the coefficient of variation of the range estimator. If this condition is satisfied 

and if v,, is small, which will be the case if N = mn is large and a mean range is used, it follows 

that &(u) will approximate to y/o, and o,, to unity, whether the population form is normal 

or not. 

7. To examine this point, I have put together in Table 1 results obtained from various 
experimental samplings carried out with the help of Tippett’s Random Numbers at Univer- 
sity College some 20 years ago. Most of the results have already been published (Pearson & 
Adyanthaya, 1928; also T'ables for Statisticians and Biometricians, 2, 167). The population 


* Using the asymmetrical test, we reject the null hypothesis if | ¢| >t, where P{t>t,,} = 4. For the 
asymmetrical test, we reject if >t, (or t<t,), where P{t>t,} = a. 

¢ It will be noted that the limiting value for p.); of 3-605 to which the standardized deviates in Lord’s 
Table 2, p. 68 above, tend is, as one would expect, the sum of the 2}. and 5 % deviates, 1-960 and 1-645 
respectively, of a standardized normal distribution. 
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distributions were all Pearson-type curves, and while these cannot represent all forms of 
departure from the normal that may occur in the tails of frequency distributions, they cover 
a wide variety of shapes; four of the six population curves are shown on p. 122 of Pearson 
(1931). It is clear that, at least, up to samples of size n = 10, the expectation of w,,/d,, and 
therefore of #,, ,,/d,,, remains remarkably insensitive to changes in the population /, and £,.* 
The value of o,,, which, however, is less important than that of the expectation in its effect 
on the distribution of u, does change considerably from the normal-theory value but so also, 


Table 1. Expectations and standard errors of the range estimator of o, namely, w,,/d, 


(a) Symmetrical distributions (types II and VII) 









































A n=65 n= 10 n = 20 
1-8 Expectation 0-993 0-921 0-839 
(Rectangle) S.E. 0-265 0-125 0-058 
2-5 Expectation 1-008 + 0-015 0-983 + 0-010 0-965 + 0-007 
(II) S.E. 0-338 (500) 0-232 (500) 0-147 (500) 
3-0 Expectation 1-000 1-000 1:000 
(Normal) S.E. 0-371 0-259 0-195 
4-1 Expectation 1-015 + 0-019 1-002 + 0-013 1-060 + 0-012 
(VII) S.E. 0-434 (500) - 0-290 (500) 0-275 (500) 
7-1 Expectation 0-965 + 0:015 0-986 + 0-018 1-046 + 0-016 
(VII) S.E. 0-473 (1000) 0-399 (500) 0-348 (500) 
(b) Skew distributions (types III and I) 
By Bs n=5 n= 10 n= 20 
0, 3-0 Expectation 1-000 1-000 1-000 
(Normal) S.E. 0-371 0-259 0-195 
0-2, 3:3 Expectation 1-009 + 0-013 0-999 + 0-012 0-990 + 0-009 
(III) S.E. 0-410 (1000) 0-259 (500) 0-205 (500) 
0-5, 3°75 Expectation 0-985 + 0-012 0-967 + 0-012 1-007 + 0-007 
(III) S.E. 0-384 (1000) 0-265 (500) 0-222 (1000) 
1-0, 3-8 Expectation 0-968 + 0-012 0-963 + 0-013 0-933 + 0-009 
(1) S.E. 0-392 (1000) 0-296 (500) 0-210 (500) 











Note.' The results are given in terms of the population standard deviation as unit. The figures in italics 
are theoretical, the others were derived from sampling experiments. The sampling standard errors of the 
expectations are calculated from s,/,/N, where s, is the standard error of w,/d, observed in the N random 
samples. The value of N (500 or 1000) is shown in parentheses. 


* The symmetrical distributions with £, = 1-8 (the rectangle) and £, = 7-1 and the skew distribution 
with £, = 1-0, 8, = 3-8 are exceptional forms not commonly met in practice. Abruptness at one or both 
terminals will reduce the expectation of the range estimator when the sample size increases: This 
effect appears in the case of the rectangular distribution and also for the type I curve, which is very 
steep at the start. 
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of course, does the standard error of s. It is known that as n’ increases the standard error 
of s equals approximately the normal theory value multiplied by ./{(@,—1)/2}. When 
n = 20, the same factor may be seen to give roughly the empirical standard errors of the 
range estimator. 

8. Inarecent paper, K. J. Shone (1949) has considered the relation between mean range 
and population standard deviation in samples of n = 2 to 5, from a number of non-normal 
populations. He found exactly, for n = 5, the following values for &(w/d,o) = w/(d;o): 








Population By, B @/(d,o) 
A 0 2-67 0-975 
D 0 1:78 0-979 
G 0 4-63 0-926 
I 0-58 3-46 0-958 
K 0°85 3°22 0-937 




















The population distributions each containing only seven discrete frequencies, spaced at 
equal intervals, were quite unlike those used in the sampling experiments referred to above, 
and it is probably for this reason that the values of w/(d;o) differ considerably more from 
unity than those given in Table 1. The latter were based on samplings from populations with 
a much more finely graded variable, and it is unlikely that any ‘grouping up’ could bring 
the two series into agreement. 


EFFECT OF ROGUE OBSERVATIONS 


9. If the sample is large, a single outlying observation will in general have a much greater 
influence on the range than on the root-mean-square estimator of o, but it is not immediately 
clear that this will be the case in a small sample. An illustration of the position can be obtained 
as follows. Suppose that x,, 2, ...,z, represent a random sample of n observations, arranged 
in ascending order of magnitude, drawn from a normal population having zero mean and 
unit s.D. Suppose now that an ‘error’ term a gets for some reason added to z,, to make it 
XxX, =%,+a.* 

The range becomes w = X,, —2,, and the expectation of the range estimator is 

é(w/d,) =1 +a/d,, (6) 


where d,, is the tabled corrective factor. The mean-square estimator of o? will be 
n—1 
= {5 @—ay+ (Xa [(m— 
i=1 
n 
where n& = > (x,)+a. 
i=1 


It can be shown that &(s2) 


1+a?/n + 2a&(x,)/(n— 1), 
1+a?/n+ad,/(n—1), (7) 


where &(x,) = $d, is the expected derivation of the extreme individual in a sample of n 
from the population mean, when ¢ = 1. 


* This device gives a rapid means of examining the effect of an outlying observation; more 
reasonably, the error should be added at random to any one of the » observations and not to the 
extreme. However, this would complicate the calculation of &(w). 
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10. When a = a, +0, the value of &(s) is not immediately obtainable, but it seems reason- 
able to assume that, approximately, 
6(8|a =a,) _ pas ts ={14+4 
E(sja=0) |&s?|a=0)) ~ 


In Table 2, the expressions (8) and (6) are compared for n = 5, 10, 20, 30 and a = 0-5, 
1-0, 2-0, the population standard deviation being taken as unit. 





Sal (8) 


n n—-l 


Table 2. Showing the effect on estimates of o of the addition of an error term, ac, 
to the extreme observation in a sample. (o taken as unity) 











Sample a= 0-5 a=1-0 a= 2-0 
size d,, 
7 J6is%) | S(widy) | Ves) | wid.) | VE) | S(wid,) 
5 1-16 1-21 1-33 1-43 1-72 1-86 2-3259 
10 1-09 1-16 1-20 1-32 1-44 1-65 3-0775 
20 1-05 1-13 1-12 1-27 1-20 1-54 3°7349 
30 1-04 1-12 1-08 1-24 1-19 1-49 4-0855 
































It is seen that for a given error term, a, the expectation of the range estimator is more at 
fault than that of the root-mean-square estimator, and that, relatively, this bias increases 
the larger the sample and the larger the error a. If there is a single outlier only, and we break 
up the sample into groups when using the range estimator, the bias is very much reduced. 
Thus if thirty observations are broken into three random groups of n = 10, it will be seen 
that &(Ws 19/d,9) has the following values: 








a 0-5 1-0 2-0 
E (Ws, 19/419) 1-05 1-11 1-22 
JE (84) (n = 30) 1-04 1-08 1-19 




















The bias in this way is only a little greater than that obtained from the root-mean-square 
estimator, applied to the whole thirty observations. A mean range based on six groups of 
five, would be less affected still. 

11. In conclusion, these results may be regarded as supporting the case for using range, 
with the adjustment appropriate for a normal population, as an estimator of standard 
deviation provided that groups of not more than about ten observations are taken. 
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ON THE STATISTICAL INDEPENDENCE OF QUADRATIC 
FORMS IN NORMAL VARIATES 


By A. C. AITKEN, DSc., F.R.S. 


1. INTRODUCTORY 


The ¢-test, the variance-ratio test and certain other tests of significance are valid only on 
condition that the linear, quadratic or bilinear forms concerned are statistically independent. 
For quadratic forms, the variates being normal, uncorrelated and of unit variance, the 
central theorem is that of A. T. Craig (Craig, 1943; Hotelling, 1944), namely: 

Let x be a vector having for elements n uncorrelated normal variates each of wnit variance : 
then the necessary and sufficient condition for the quadratic forms x' Ax and x' Bx to be statistically 
independent is that AB = 0. 

Some years earlier W. G. Cochran had obtained (Cochran, 1934, p. 181) the equivalent 
but less easily applied condition that 


|I-aA—pB| = |1-2A||1-AB| (1) 


identically in the real indeterminates a, #. In the present note we shall derive Craig’s 
criterion from Cochran’s condition, and we shall point out some corollaries. 


2. Proor or CRAIG’S THEOREM 


The joint moment-generating function or Laplace transform of x’ Ax and 2’ Bz is found at 
once (Cochran, 1934; Aitken, 1940) to be 


G(a, 8) = (2n)-[" exp (— $a’x+ hax'Ax+}fx' Bu) dx = |I-aA—£B|-, (1) 


provided « and f are in a real region such that J —a«A — £B is positive definite. 
The necessary and sufficient condition for independence, namely, that 


G(a, B) = G(a, 0) G(0, ), 


then yields the condition quoted in §1(1). For convenience we shall write it in the homo- 
geneous form 


A" |AI-—pA-—cB| =|AI-pA||AI-cB|, (2) 


where p, o are the arbitrary (real) indeterminates, in a suitable region. This shows that the 
latent roots of the matrix pencil pA +oB are the latent roots of pA together with those of 
oB, with the useful corollary that the rank of pA + oBis the sum of the ranks of pA and of cB. 
Also in the first place, and without loss of generality, we may suppose that an orthogonal 
transformation has been applied to the pencil, of such a kind that acting on A alone it 
produces a diagonal canonical form with the non-zero latent roots of A, let us say a, 
(i = 1, 2,3, ..., 7) appearing in leading position in a submatrix A,. It is permissible therefore 
to take A as given in this shape. Further, this being done, it is possible that the rows later 
than the rth in the transformed pencil may be linearly dependent among themselves. In such 
a case we could apply a further orthogonal transformation to reduce to nullity any redundant 
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rows, and the corresponding columns, thus removing from the. problem any redundant 
variates. 

The problem is thus simplified to one in which, for real and non-zero p and o, the pencil 
pA+cB is of full rank n = r+s, where r is the rank of A, and s is the rank of B. Since the 
latent roots of the pencil are known, there exists an orthogonal transformation to canonical 
form, let us say 


Q(pAroBg=[(° |. |, (3 


where B, must be diag [/, £, ... £,], the £; being the non-zero latent roots of B. Let us partition 
B accordingly and examine the determinant of the pencil. We must have, identically in 
o and p, 

i | pA, 


PA, +oBy, cB, 
oB, TBy. 





oB, |" (4) 





The coefficient of p’c* on each sidé of this gives 
| Boo| = | B| = Ai Ag... Be- (5) 


Now Bis of rank s, and so is B,,. Thus the following congruent transformation, involving 
a submatrix K, exists: 


I Tue Bylfl | <f [: J (6) 
iva Vr Oe es Mee 
Applying this to B—AI and constructing the characteristic polynomial of B, we have 
therefore 


—A(I+K’'K) —AK’ 


The determinant on the right of (7) has a factor A’; this merely illustrates the fact that r of 
the latent roots of B are equal to zero. The other factor of the determinant has | J + K’K | | B,,| 
for its constant term, and this by matrix theory must be equal to /,/,... £,, that is, by (5), 
to | B,.|. Hence |I+K’K| = 1. Since K’K is non-negative definite, this can hold only if 


K = 0. Hence finally by (6), 
B=|" me (8) 


Thus the submatrices A,, the non-zero part of A, and B,», the non-zero part of B, are disjunct; 


and so AB = 0, as was to be proved. The sufficiency of the condition now follows at once 
from (2). 


| Bar| -| (7) 





3. EXTENSION TO CASE OF CORRELATED VARIATES 


Next, let the elements of the vector x be variates obeying a normal law characterized by 
x’ V~-1z, where V is the variance matrix. Since V is positive definite, it admits a real square 
root V3. 


The transformation y = V-!z then produces uncorrelated variates y, all of unit variance. 
The quadratic forms x’ Az and 2’ Bx become, in the new variates, y’V+ AV+y and y'V? BVty. 
The necessary and sufficient condition for their independence is 

ViAVi. ViBVi=0, thatis, AVB=0, 


the appropriate extension of Craig’s theorem. 
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4. THE DEPENDENCE OF A QUADRATIC AND A LINEAR FORM 


In the case of a linear form a’x with zero mean and a quadratic form 2’ Bz, the author derived 
a condition (Aitken, 1940) of independence, namely, that 


a'(V—£B)-1a_ should be independent of £. (1) 
This result, however, like that of §1(1), could have been pressed further. Let us square 


the linear form, obtaining the quadratic form x’aa’x. By §3, the necessary and sufficient 
condition for this to be independent of 2’ Bz is that 


BVaa' =0, which further yields BVaa'a = 0. (2) 


Cancelling the non-zero scalar a’a, we derive the simpler condition BVa = 0, which is easily 
seen to be sufficient as well as necessary. 


5. THE INDEPENDENCE OF BILINEAR FORMS 


Bilinear forms y’ Ax, y’ Bx may be constructed from sets of normal variates either independent 
or intercorrelated. In.either case we may pool the variates and then regard any bilinear form 
as a quadratic form in the combined set. Craig’s theorem can then be applied, and leads to 
various subsidiary theorems, which can be enunciated if desired; in practice, however, it 
seems easier to apply the theorem in its primitive form and not to particularize. 

We consider, however, a possible case. Let the elements of x be r variates, those of y be 
the complementary s variates in a set of n = r+ variates having V for their variance matrix. 
Consider bilinear forms y’ Az and y’ Bz. Apart from a factor 2 they may be written as matrix 
products, quadratic forms, thus: 


em “W} emf IG} 


Partitioning V suitably, we may write down Craig’s condition of independence as 
>> TR Re!) AR [ ; ad _ [AV 2B ‘ae Lee (2) 
Ange ere oi) ae: Aw 
This yields an easily applied criterion, which simplifies further in the case when V,, = 0, 


that is, when the two sets of variates are correlated within, but not between, their respective 
variates. 


6. CoCHRAN’S THEOREM ON INDEPENDENT QUADRATIC FORMS 


Thus far we have not specialized the quadratic forms. For example, we have not insisted 
that they should be non-negative definite. But in the theory of analysis of variance there is 
a theorem on quadratic forms (Cochran, 1934), in which conditions of definiteness are 
imposed. Formulated as a theorem on matrices, it is as follows: 

Given (i) that A,+ Ag+... +A, =I, where all the matrices A; are real symmetric matrices 
of order n x n; (ii) that the ranks n, of the A; sum to n: then the separate A; are idempotent, and 
there exists an orthogonal matrix H such that the non-zero parts of H'A,;H are disjunct diagonal 
submatrices, with unit diagonal elemenis. 

The theorem admits a proof on matrix lines. Let us first apply an orthogonal transforma- 
tion H, which would reduce A, to leading diagonal canonical form. We then have 


BN: Pedlipl 
HAH, =|" ‘! Hi(Agt Ay... + A) Hy =[ + - (1) 
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But, since the rank of a sum of matrices cannot exceed the sum of the ranks of the separate 
matrices, the rank of A,+A,+...+A, cannot exceed n.+7,+...+7,; and since the rank 
of the lower submatrix J on the right of (1) is certainly n.+,+...+7,, we must have 
I—D, = 0, that is, D, = J. Inasimilar manner we can proceed, transforming each successive 
A,, independently of its predecessors, to its disjunct canonical form of n, unit elements. It 
follows that the A; are idempotent, and that the quadratic forms x'A;z are independent 
sums of squares, are in fact functions of x? type with respective degrees of freedom n,. 


7. THE INDEPENDENCE OF NON-NEGATIVE QUADRATIC FORMS 
In a paper that has lately appeared (Matérn, 1949) it is proved that for non-negative quad- 
ratic forms x’ Ax and 2’ Bz in normal variates a sufficient condition for independence is that 
the forms shall be uncorrelated. This, in the case of independent normal variates x of unit 
variance, is shown to be equivalent to the condition 
tr AB = 0, (1) 


where ‘tr’ denotes trace or sum of diagonal elements. If the variance matrix of the vector 
x is V, the appropriate extension of (1) is 


tr AVBV = 0. (2) 
Matérn’s result, for the case considered, implies Craig’s theorem. For in the first place 
since tr AVBV = tr(V#AV?. Vi! BV}) 


we can proceed without loss of generality (§3) as if V were J. But then also 
tr AB = tr (Bt Ai. A} Bb), 


in virtue of the fact that a non-negative definite symmetric matrix has a non-negative 
definite square root. Since the matrix on the right is non-negative definite, the vanishing 
of its trace implies the vanishing of all its diagonal elements, and this implies the vanishing 
of all the elements of A? Bt. Hence AB = A}, A? Bt. Bt = 0. 

Thus Matérn’s criterion, in the non-negative definite case, is equivalent to Craig’s, but 
simpler. 

The outcome is a criterion for the independence of non-negative definite quadratic forms 
which is perhaps the simplest of all to apply, namely: 

The necessary and sufficient condition for the independence of x’ Az, x’ Bx is that all 
the diagonal elements of AVBV (or BVAV)shall be zero. 
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TWO COMBINATORIAL TESTS OF WHETHER A SAMPLE HAS 
COME FROM A GIVEN POPULATION 


By F. N. DAVID 


1. The question as to whether a sample has come from a given population may be answered 
in two different ways. We may take the sample and carry out tests of significance regarding 
the sample mean, the sample variance and so on, each time obtaining an answer which tells 
us about tuat particular facet of the composition of the population which is revealed by the 
given sample test criterion, but we obtain no picture of the population as a whole. The 
alternative method of approach is to specify the possible functional form of the population 
and the necessary parameters of this functional form, and by means of the y? criterion to 
test whether the sample could have been drawn from such a population. This latter test, in 
which the alternatives to the hypothesis tested may be whatever one likes—different 
functional form and/or different values for the parameters—appears to the writer most truly 
to answer the question ‘Could the sample have come from a given population?’ The x? test 
does, however, suffer from the defect that it can only be applied to large samples because of 
the approximations involved in the derivation of its sampling distribution. Two tests are 
proposed here. The first is an omnibus test in which all alternatives to the hypothesis tested 
are regarded as admissible and which may be used instead of y? when the size of sample is 
very small. The second test, a variant of the first, is more sensitive because it allows us to 
specify broadly which departures from the hypothesis under test it is most important not 
to overlook. 

2. It will be assumed that the hypothesis tested, which we shall denote by H), is that the 
population, from which a sample of N observations has been independently and randomly 
drawn, is a continuous distribution of specified functional form and with given parameters. 
We suppose that this population is divided into k groups or strata of equal probability, and 
we plot the sample points noting into which strata they fall. It is clear that if these points 
are very regularly dispersed among the k strata then we have a situation analogous to that 
producing a very small value for y?. For example, if we make k = N and there is one sample 
point in each group, then expectation is exactly realized. On the other hand, if all the sample 
points fall into one or two groups there is »bviously a big departure from expectation corre- 
sponding to a large value of x?. We shall take therefore the number of groups containing no 
sample units—or if it is preferred, the number of groups containing at least one sample unit 
—as our test criterion. 

3. The mathematical analysis required to find the distribution of the zero, or the non- 
zero, groups is very simple. It is given in great generality by Laplace in his Théorie des 
Probabilités (see also F. N. David, 1949). A simplification of the function derived by Laplace 
was discussed and tabulated by E. M. Elderton & K. Pearson (1925) and again later by 
W. L. Stevens (1937). Stevens was concerned with a test for randomness, which, viewed from 
one aspect, is what the test. proposed in § 2 is also. We postulate a box divided into k equal 
and identical compartments. N identical balls (N <k) are dropped randomly into the box, 
any number of balls being allowed to fall into any one compartment. The number of ways in 
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which these N balls can arrange themselves in any k--t compartments, leaving ¢ empty, 
can be shown to be equal to kC, Ak1ON, 


where A*O% is the (k—t)th leading difference of the Nth power of the natural numbers 

0, 1,2,3,..., ete. Hence the probability of ¢ empty compartments, given N balls and k 

compartments, is ko 
P{t|k, N} = ph (0%. 

This result can be shown to be true also for N > k. 

4. The analogy between the box, compartments and balls, and the probability integral, 
the groups of equal area and the sample units is obvious. N, the number of balls, is fixed by 
the sample size, but it is not immediate what value to choose for k, i.e. into how many equal 
parts we shouid divide our probability integral. Since this proposed test is to be used in 
a way analogous to y?, we recall the two different types of hypothesis alternate to that tested 
by the x’ criterion. We test the hypothesis that the functional form of the population and/or 
the given values of the parameters are what they are postulated to be. If we use the upper 
tail of the y* distribution as a critical region then we have in mind as an alternative that the 
functional form and/or the given values of the parameters may be different from those tested. 
If we use the lower tail as a critical region, then the alternative hypothesis is complex and 
is concerned with the randomness or independence of the sample used for the test. The same 
situations obtain for the zeroes test and it is necessary to bear them in mind in choosing the 
value of k. : 

If k is chosen to be less than N we curtail the range of the probability distribution of the 
zeroes without achieving anything in compensation. The test will be insensitive in both 
directions and zero groups will be few, even when the functional form of the population is 
the correct one. This would suggest making the number of groups large. However, if we 
take k > N the test will become insensitive to alternatives of the kind picked out by a very 
low x’. For if k> N there will be always at least k— N empty groups, no matter how the 
balls are distributed. It would appear, therefore, that the best balance to the test will be 
obtained when the number of compartments is equal, or nearly equal, to the number of 
balls. We illustrate this point in Table 2 with a sample of 5. Clearly if k = 5 there would be 
the possibility of establishing significance at either tail, even when N is as small as 5. This 


Table 2. Variation of probabilities of zero groups as k, the number 
of compartments, varies. (Sample size N = 5) 




















Compartments 
No. of 
zero groups 
3 5 8 
0 0-6173 0-0384 
1 0-3704 0-3840 
2 0-0123 0-4800 
3 0-0960 0-2051 
4 0-0016 0-5127 
5 0-2563 
6 0-0256 
7 0-0002 
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is not the case for NV = 3 or 8. This question of the appropriate number of compartments 
to use is, theoretically, capable of solution by the use of power function technique, and the 
attempt was made to do this using the power function given in a later section. It is, however, 
proposed to use the test only for small samples, where the x? test is not valid, and with these 
small samples the effect of discontinuities renders accurate comparisons between the power 
of the test for fixed sample size, but varying numbers of compartments, almost impossible. 
Calculations were carried out, and the suggestion which comes from them is that, for a fixed 
sample size, increasing the number of compartments tends to increase the power of the test 
using.the upper tai! of the sampling distribution but decreases the power of the test using the 
lower tail. We cannot state that to take the number of compartments equal to the number of 
balls is the optimum solution to the problem—it is possible that there will be a different 
optimum solution for each sample size. We can, however, state that when k = N the two 
tails of the distribution are reasonably well balanced and we shall adopt this for our test. 
The proposed test will consist therefore of the following steps: 
(i) Divide the probability integral into as many equal groups as there are units in the 

sample. (This is easy for any well-tabulated function.) 

(ii) Count the number of groups containing no sample units. 

(iii) Refer to Table 1b to judge whether the number of zero groups is too small or too large. 
The function NC,AN-ON 

an 


P{t| N} = 





is tabulated in Table 1a and the (nominal) significance levels in Table 16 for N = 3 to 20. 

5. The zeroes test presented above will undoubtedly be insensitive, just as x? is insensitive, 
when compared with any test which is specifically designed to test a possible given departure 
from H). The power function for the case when H, is false and an alternative hypothesis H, 
is true may easily be written down. We shall denote by 


N! j 
~ (1!)%a,! (2!)%a,!...? ; 





P(a, aq... @;) 


the elementary partition function giving the number of ways in which N balls may arrange 
themselves in ¢ compartments so that a, compartments contain one ball each, a, compart- 
ments contain 2 balls each, ...,a; compartments contain j balls each. This is the same function 
as that denoted by David & Kendall (1949) as the augmented symmetric function, and we 
note that AtON 


UP(a,a,...a;) = aT 


the sum being taken over all possible partitions of N by t. Let p,, po, ..., Py be the probabilities 
of a sample unit falling into the first, second, ..., groups under the alternative hypothesis Hj. 
Writing P; for the probability of ¢ zero classes under H,, we have 


Py ha =p, 


Py_2 = YL P(a,a,).2 = ph pj, 
r,38 i+j 
Py3= L P(a,a,4,)LUUpppjpr, 
i+j+h 


T,8,m 
P= Xz... Up,p;...py (N summations), 
itj+ +f 
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the range for all & summations being from 1 to N. Thus for N = 5 we may write down im- 
mediately from David & Kendall’s tables 


5 
R= = pi, 


a=1 
P= SLU pip, +10&L= pip}, 
a+b a+b 
P, = 10L ZU pip, p.+ 1S LUE prp}p,, 
a+b+c a+b+c 
P,=10 ZXXX pipyp.Pa 


a+b+c+d 


Py = LULUZUp Py P.PaPe- 


a+b+c+d+e 


These probabilities may be turned into an easy form fo compuéation from the tables quoted, 
and we have for VN = 5, remembering 


5 
2p,= 1, 
that P, = X75, 
a 


P, = 52 ph+ 1072) (=22)- 15% pi, 
a a a ns 


‘ ; 
P, = 105 p3+ 157) — 352 pi+ 505 p8—40(E 72) (E78), 
a a a a ° a \ / 


. 
P= 105 pt 305 p2 — 30( 5 78) +603 ph-+50( E72] (= p8) - 603 76. 
a a a a a a a 
2 
P, = 1-103 ph-+ 20 p2 + 19( 8) ~ 30 pt—20(5 p2) (= p8) +24 pf. 
a a a a a a / a 


All summations range from a = 1 toa = 5. If the number of compartments is different from 
5, then the coefficients remain unaltered, but the range of the summations becomes i to k. 
The power of the test will be given by the sum of the probabilities for those numbers of zeroes 
which fall outside the significance levels given in Table 16. Thus, for the case N = k = 5, it 
will be necessary to compute P, or P, only. 

6. There may be occasions on which difficulties will arise in the division of the probability 
integral which is necessary in order to carry out the test. For example, the division of a 
Type III curve into seventeen equal groups may be troublesome in spite of Salvosa’s excellent 
tables (Carver, 1940). An alternative method is to make use of the probability integral 
transformation. Thus if x is a random variable distributed with probability law p(x | A), 
then the random variable y, connected with x by the relationship 


y=" p(x | Hy) dx, 


is rectangularly distributed in the interval [0,1]. If therefore we take our N sample obser- 
vations, x, and transform them to N rectangular observations, y, the problem of finding the 
number of zero compartments reduces to dividing a rectangle, length unity, into N equal 
parts along its length, plotting the transformed observations y, and counting as before. This 
procedure may be preferable in some cases. 

7. It is clear that whichever method we use—dividing up the probability integral or the 
rectangle—as the size of sample increases the arithmetic is going to be laborious. If z be the 


F 


er- 
she 
ual 
his 


she 
he 


F. N. Davip 101 


random variable of which the number of zeroes in the sample is one observed value, then 
Stevens suggested (without proof) that we should assume z is normally distributed with 
mean and variance which he derived and which, for N balls and k compartments, will be 


&(z) = X(1 -i) 


&(z-&(z))? = Xf (e— n (1-3) +(1-7) -*(1-3) |. 


Table 3. Comparison of exact probabilities of the distribution of z 
with the normal approximation (N = k = 20) 
































z Exact Normal z Exact Normal 
0 —- _- 10 0-6378 00394 
1 — — ll 0-0070 0-0077 
2 — — 12 0-0007 0-0010 
3 0-0029 0-0044. 13 — -- 

4 0-0216 0-0240 14 — — 

5 0-0874 G-0883 15 a — 

6 0-2031 0@-1997 16 - —- 

7 0-2811 0-2768 ze = — 

8 0-2365 0°2855 18 — — 

J 0-1215 | 0-1231 19 — — 
{ 





To show that the limiting form of the distribution of z (k, N +00} is normal will call for much 
heavy algebra, but we may get some idea of its adequacy from Table 3. For N = k = 20, 
applying a continuity correction to the normal scale, we have the comparison given in the 
table. It is clear that for N > 20 there will be little risk of error in assuming that z is normally 
distributed. It is suggested therefore for samples of N where 20< N < 30 that the normal 
approximation should be used. Further to this, in order to avoid the labour of dichotomy, 
it is suggested that a small addition to the insensitivity of the test be accepted and that the 
number of compartments, k, should be taken equal to 25 in all cases. For N > 30 the simplest 
test is to divide the probability integral into six or more equal compartments, so that the 
expectation in each compartment is 5 or more than 5, and to carry out a x? test. 

8. It is of interest to compare the power of the two tests, the zeroes and the y? tests, at 
the suggested cross-over point, N = 30. Stevens did not discuss or derive the distribution 
of the zeroes test under H,, but he did find, incidentally, its mean and variance, and suggested 
a method of approximation which will be applicable in our case if the differences between the 
probabilities in each group under H, and under H, are not very large. Following the notation 


of §5, we have k 
&(z) m zl —p,)%, 


kk 
&(z(z—1)) = & X (1—p;—p,)*. 
i=1j=1 


i+j 


For departures which are not very different from H, we may write 


1 
R= Ett 
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k 
where obviously La, = 0, 

i=1 

k 
and we write Lazj=a. 

i=1 
We may deduce then that 

1\Y (aN -—1) 1\-2 
(2) = (1-7) 4 3 Es (1-3) a, 


&(2—&(2))? = Hf (e- 1) (. -i)"+ ( -})"-o1 = ] 


+N(N- tal (e- 2) (. -7)"+3(1 -;)- #1 -i)], 


if we neglect terms involving sums of powers of af for s > 2. We do not know what the dis- 
tribution of z under H, will be, but for small departures from H, we shall not expect normality 
to be greatly upset. We shall therefore assume that the distribution of z under H, is normal 
with mean and variance as given immediately above. 

To get the power of the x? test we follow Patnaik (1949). If we assume that the probabilities 


under H, are 7,,7,...,7, and under H, are ,, po, ...,p,, then Patnaik showed that the 
quantity (Observed — Expected)? 


x 
All groups Expected 





is distributed approximately as non-central x? with parameter 
k pt 
A= y( zs 1) 


and degrees of freedom k—1. He gave tables from which, knowing A and k— 1 and the signi- 
ficance level of rejection under H,, the power of the x? test to detect the alternative hypothesis 
H, can be evaluated. Similar tables have also been calculated by E. Fix (1949). 

We shall take the case of a sample of 30, and for illustrative purposes we take the hypo- 
thesis, H,, that the sample has come from a normal population with zero mean and unit ) 
standard deviation. H, will be that the sample has come from a normal population with zero 
mean and with standard deviation ¢. For the zeroes test we take k = 25 and we find for a 
5 % level of rejection under H), that the power of the test to detect the alternative hypothesis 
is 0-183. For the x? test we divide the unit normal curve into six groups of equal area, thus 
ensuring an expectavion of 5 in each group. 7; = } for i = 1,2,...,6. The quantities p, are 
calculated corresponding to the dichotomy under H,. We obtain A = 2-477, k—1 = 5 and 
interpolation into Patnaik’s tables gives us the power as approximately 0-189. We see then 
that the power under the two tests is comparable. 

Both the approximations to the power functions given above will hold (strictly) when the 
alternative hypothesis is not very different from the hypothesis tested. Numerical calculation 
has shown that Patnaik’s approximation to the power function of y? will give reasonable > 
results for the power even when the alternate hypothesis is some way removed from that 
tested and in consequence the power is large. This unfortunately will not be the case for the 
approximation proposed for the power of the zeroes test and another approach is necessary. 
As the power of the test increases it will be found that a few of the p,’s become large and the 
remainder very small. For example, when the hypothesis alternate to that tested is that 
there has been a shift in the population mean to the right, then as the divergence becomes 
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large p;,,—> 1 and all the other p’s tend to 0. This suggests that we expand the moments of z 
in ascending powers of the p’s, most of which will quickly become negligible. Thus 


k 
E(z) = & (1—-p,)¥ = kK—NO, Dp, +%C, Up? NCU pF +..., 
{=i 


k k 
E(z(z—1)) = & LX (l—p,;—p,y WV = k(kK—-1)—4C, LX (p,+p,)+%C, LU (p,+ p,)?-.... 
“i t+j i+j 
The double sums may be reduced to single sums and we have 
2 2 (pi+p;) =k-1+U(k—-1)p, 
ij i 


LD p+ p;)? = 2+ 22 (k—2) pi, 
i+? i 
i+j i 7 


by making use of tables of symmetric functions. This procedure will be adequate for large 
divergencies from the hypothesis tested. It should, however, be used with caution because 
the assumption that z is normally distributed under H, need not necessarily be true in 
these cases. 

9. The test for the counting of the number of zero classes supposes that the functional 
form of the population under H, is specified and the parameters also. But if sample moments 
are used as estimates of the parameters, the distribution of the number of zero classes will 
no longer be that given above owing to the restriction of the sample space. The test is therefore 
limited in application, a fault which it shares with most goodness of fit tests which have been 
proposed, the classic exception of course being x?. Recent work by David & Johnson (1948) 
on the probability integral transformation suggests that when x is subjected to two sample 
moment restraints, the transformed variable y defined in §6 cannot be regarded as being 
effectively rectangularly distributed until N > 30. The procedure suggested above therefore 
will probably not lead to grave risk of error when one or two moment restraints are placed 
on the sample space, provided the sample size is greater than 30. Whether one would wish 
to use the zeroes test in such a case is 2 matter of opinion; probably the simplest thing would 
be to apply the x? test as suggested earlier. 

10. It will be recognized that the zeroes test proposed above is another addition to those 
tests of significance and of goodness of fit which are based on the probability integral trans- 
formation. E. S. Pearson (1938) discussed the theory of tests based on this transformation 
in some detail and pointed out that in order to overcome the lack of power associated with 
‘omnibus’ tests it is necessary to define the way in which there may be departures from rect- 
angularity, in order to devise tests which will be sensitive to these departures. We shall still 
consider, in this second test proposed below, the configuration of the zero classes in the 
sample, but we shall associate certain broad types of departure from the rectangular hypo- 
thesis with certain configurations of the zero classes, thus going some way towards satisfying 
the requirements laid down by E. S. Pearson. Suppose, for the sake of example, it is desired 
to use the zeroes test to take account of a possible shift in location of the population mean. 
If all the compartments to the right of the distribution are filled and none of those on the 
left, then it would be reasonable to suspect a shift in the population mean to the right. Again, 
if all the compartments in the centre of the distribution are filled, and none of those towards 
the two tails we might suspect a reduction in the population standard deviation, and so on. 
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We shall therefore base out second test on the configuration of the zero compartments in 
k specified compartments. These k will be selected before the analysis of the data, as being 
the most likely for an alteration in the number of zeroes to occur in them if the hypothesis 
tested is not true. We have again to face the question as to what should be the value of k to 
aim at. Presumably, arguing as before, we should now aim at making k, the number of 
specified compartments, equal to NV, the number in the sample, and it will be undesirable 
to have the number of unspecified compartments, > N or <N. We shall therefore divide 
the probability integral into 2N compartments and we shall choose k = N of these for the 
test. In this test the presence of too many zero classes in the specified N groups will lead to 
rejection of the hypothesis tested. The presence of too few zero classes will not lead, however, 
to a suspicion of a lack of randomness, as it did in the test proposed earlier, but probably to 
a questioning as to whether the alternative hypothesis proposed is in fact the appropriate 
one to take into consideration. 

Thus, if a change in the mean is suspected, we shall consider the configuration of the zeroes 
in the left-hand N or the right-hand N compartments, according to the direction in which 
the change is suspected. If we wish to take account of a change in the standard deviation, 
the mean being the same, then we shall divide the 2N compartments into three classes, 
the sum of the compartments in the outer two classes being NV, and so on. 

11. Our problem then corresponds to that of dropping N balls at random into 2N com- 
partments and of finding the probability of 0,1,2,...,N zeroes in any specified N com- 
partments. It is clear that the total number of arrangements of the N balls in the 2N 
compartments will be (2N)%. Let z be the number of zeroes in the specified N compartments 
and let A, be the number of ways in which z may arise. We have then 


A N! AQN N! A?ON si ae NN 
v=(N-1)) 11 ‘Ww-2)!) 2) °°" 4.W-nin ~"’ 
N! ArON ae ae WN Net N N 
Ay4= DNase a CANN = NO((N + 1)Y—N™), 
and generally 
N! N rt ele N! 
Ave Waal 2, OT Worse 


with A, = NI. 


= NC,A'NN, 


The probabilities of 0,1, 2,...,N zeroes in the given N compartments are given by dividing 
the appropriate terms by (2N))’. The probability function is tabulated in Table 4 a and b. 

12. Example I. A sample giving values — 8, +7, +1, +10, +1 is assumed to have been 
drawn from a norma! population with mean, £ = 0, and with standard deviation a = 10. 
Test this hypothesis against alternatives which assume that £ > 0. 

From Table I of Tables for Statisticians and Biometricians, Part I, we read off the lines of 
dichotomy to be —0oo, —12-8, —8-4, —5-2, —2-5, 0, 2-5, 5-2, 8-4, 12-8, +00, and find that 
sample points fall in groups 3, 6, 8and 9 counting from left to right. For alternative hypotheses 
making £ > Owe take the left-hand five compartments, in which there are four zeroes, and find 
from Table 4a below that this is not an uncommon configuration. In fact, the probability 
of four or more than four zeroes is 0-264. Table 4b shows that for a sample of size 5 significance 
will only be established if all five compartments specified are empty. 

Example II. A sample of 4 units is assumed to have been drawn from a normal population 
with mean £ = 0 and standard deviation o = 10. The hypotheses alternative to that tested 
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assume that there has been a reduction in the population standard deviation. Our lines of 
dichotomy are —oo, —11-5, —6-7, —3-2, 0, +3-2, +6-7, +11-5, +00 and we decide to 
take groups 1, 2, 7 and 8 to test our hypothesis. The sample values are — 6, 0, 2, 2. 

We choose our test compartments before looking at the sample values, an important point. 
It is seen that no sample points fall into the test groups so that z = 4 and we may therefore 
reject the hypothesis that the parent population is described by a normal curve with mean 
£ = 0 and standard deviation 7 = 10 and proceed under the assumption that the normal 
curve describing the population will have = 0 and 7 <10. In proceeding in this way, we 
shall in fact be wrong on the average six times in every 100 occasions. 

13. The factorial moments of the distribution of z may be derived in straightforward 
fashion. We know that 








N! AsNN 
Py-s = Gy—s)lel QIN for s=0,1.,...,N. 
Writing (N —s)l = (N-—s)(N—s—1)...(N—s—k+1), 
it is immediate that x ‘ " Nw Nk P ie 
ae y ae Seen = 8N- 
tk =s 8) Py_s (QNy¥,~ C,A 
oo y-z wn — 5” ow-enn 
a. retains. caine 
k\¥ 
= | eee 
sm." 


We notice that when k = 0 the result is unity as expected. When k = 1 we have 


, 1 wad 
4 = N ( 1— oN x) ~ 
and we deduce from k = 2 that 


mola) Cay ay) 


moments which bear a certain similarity to those quoted for the first test. Higher moments 
can be deduced, if required, from the general formula given above. 

14. The shape of the distribution of z for N = 10 (given in Table 4a) suggests that the 
normal curve may be a good approximation. A compaiison between these exact values and 
the values obtained from a normal curve with moments as given in the preceding section is 
given in Table 5. A continuity correction is necessary. It will be seen from the table that the 


Table 5. (Distribution of N balls in a specified N out of 2N compartments.) 
Comparison of exact values and normal approximation for N = 10 








z Exact Normal z Exact Normal 

10 0-0010 0-0022 4 0-0901 0-0920 
9 0-0156 0-0186 3 0-0176 0-0195 
8 0-0881 0-0892 2 0-0016 0-0022 
7 0-2334 0-2289 1 0-0001 0-0001 
6 0-3194 0-3149 0 0-0000 0-0000 
5 0-2332 0-2325 



































106 Two combinatorial tests 


agreement between exact values and the normal theory approximation is good enough for 
practical purposes. It is suggested, therefore, that for samples greater than 10 the normal 
approximation may be used for tests of significance. 

15. The derivation of the power function of this second test presents little difficulties in 
reasoning, although it is laborious to write down. In most combinatorial problems it is often 
easier to write down the power function and from it deduce the probability distribution of 
the criterion when the hypothesis tested is true. The fact that the probabilities are different 
for all compartments makes it difficult to overlook certain combinations which are all too 
easily passed over when the probability is the same for all compartments. Let the probabilities 
for the N compartments specified for test be par, Ppr, Per, ---» Pwr, and let the probabilities 
for the other compartments left be p,7, p47, -.-, Pyz- Given these probabilities we have 


Pie=N}=<Upe_t+lUlpvicpict+ DL porvPirPert+--- 
a r,sa,b r,8,ta,b,c 


NN WN 
where x standsfor = x 2X, ete., 
a,b,c a=1b=1c=1 
a+b+c 


and all summations unless explicitly stated otherwise run from 1 to N. The outside sum- 
mation > in each case is taken over all possible partitions of N, excluding zero as a part. 
It is easy to show that the above expression reduces to 


N N 
Pie = N}= (2 p.z) ° 
a= 


Using the partition notation of §5, we may write down the other probabilities for z. We give 
the expressions for z = N—1 and z = N —2, the others may easily be deduced in a similar 
fashion: 


Pi = N-l=<Xph+ Y XE Play, 4s) (por Por + par PEL) 
a a,;,Q@, a 


+z Play, dya)( Eve piete+ © Evenvirees +2 = phir vit ve) 
a, c a,e ,c a 


Gi,04,s 


+z Play, 45,4) ( = Upp ppt. + © Uphptept. ps 
b.c,d a a,ce,d b 


Gy, Ay, As, A 
+ 2 LpiprPerpa.t = E pis pi. per) +ete 
a,b,d c a,b,c d 
For the sake of simplifying the arithmetic, the multiple sums can be expressed as products 
of the one-part symmetric functions (i.e. power sums) from David & Kendall’s tables. Again 
P{z = N-2}= & P(a,,a,) > Parr Por + xX P(a;, 42, a3) 
G;, Gs a, 


a, Az, As 


x (= > Pair Por Pek + x > Pair Po Perr + x E py perPer] 
a a,ec a 


b,c 
+ > P(a,,aq,4z, a,)( x parPer Xu pt p4y + all possible pairs of products) +-ete. 
Gs, Gs, As, A a,b c,d 


The final term will be 
P{z = 0} = . Pas y Par Por Per ++ Pur: 
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16. The formal expressions for the first two moments of z are immediate. We have, in 
general, for N balls and k compartments 


k 
E(z) = z(t —Par)’, 


kk 
E(2(z-1))= X UX (1—Pap— Pox)”. 
b=1a=1 
a+b 
We note that if all the p’s are equal to 1/(2k), we obtain the moments of § 13. A technique 
similar to that used previously will give these moments in reasonable form for the case when 
the difference between the two hypotheses, H, and H,, is small. Thus we write 


1 
Pi i Et te 
k k 
whence La; = XUp,—, 
ja” ‘Gu 
d ee + Pee 
a ro a -sae eens 


Hence, assuming 2 a is negligible for s > 2, 
a) -2a-po"-2(1-2-a,)" 
$(2) = E(1—p,) =2(1-3,-«) 
1 \¥ 1 \X-1 &k N(N-1) 1 \X-2 & 
= kH1i-—) - asl Pai poll ign 2 
1-3) -N(I-g) Bat “P(g ) Bat 


where we write i for simplicity instead of the subscript a7’. The summation is taken over all 
the compartments assigned for test. Again 





4 ’ l N 1 N-1 k k N(N-1)/ 1 N-2 - 
6(e(2—1)) = Mk—1)(1-7) - (1-7) 2 Retaerry (1-7) BE (a bay) 
7 


and EE (a;+a)) = ak-1)(¥ p,-4), 
ij i=1 

LX (a, +a,;)? = Wk 2)(Spt- FE p.+ a) + 2(Z p, — $)*. 

i+j 
We need thus only evaluate the corrective terms containing the a’s in order to obtain the 
mean and by deduction, the variance, of the distribution of z under H,. Since we have shown 
that z is approximately normally distributed under H, when N = k = 10, and since we have 
assumed H, is not very different from Hp), it appears reasonable to assume that z is approxi- 
mately normally distributed under H, with mean and variance as given above, where k is 
put equal to N. Such assumptions will enable us to obtain the.power of the test for samples 
of 10 and over without recourse to the laborious working out of the appropriate terms of the 
power function. When H, is very different from H, and the power is large—the case most 
often needed in practice—p,, will usually be very small and expansions therefore of &(z) 
and &(z(z—1)) in terms of the p’s will not be laborious to evaluate numerically. We note, 
however, as for the previous test, that it is not known whether the assumption of normality 
will hold in this case. . 

17. For the sake of exampie we compare the power of the zero test to detect an increase 

in the population mean with that of the power of the test which would undoubtedly be used 
in practice based on the sample mean. We take the sample size of 5. The power function 
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obtained by assuming the sample mean is normally distributed about the population mean 
with standard deviation equal to 7/,/n is drawn out in Fig. 1, and also P{z = 5}, both for 
the alternative hypotheses that the popclation mean has increased. The risk of rejection of 
the hypothesis when true has been fixed in both cases at 0-03125. When the orthodox test 
gives a power of 90 %, the zeroes test has a power of 65 %, a satisfactory result considering 
the broad class of alternative hypotheses to which the latter test can be made to apply. 
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Shift of population mean in multiples of o 


Fig. 1. Power of tests to detect a change in the population mean. 
—--—-— orthodox test with sample mean; zeroes test. 





Prof. Pearson has pointed out to me that in applying the zeroes test in this way, i.e. to 
detect a shift in the population mean, I am using here an interesting variant of another test. 
It is known that a quick approximate method of testing whether there has been a shift in 
the population mean is to see how the sample units fall about the mean, £, specified by the 
hypothesis tested. If all the sample units fall to the right of € then the orthodox test using 
the sample mean will be likely to give a significant result, unless of course there has been at 
the same time a reduction in the population standard deviation. The zeroes test consists in 
noticing how the sample units fall about the population median. Table 4a shows that for 
samples of 7 and less it is necessary for all observations to lie on the same side of the median 
in order to obtain a significant result. For samples of 8, 9 and 10 one observation may lie 
on the opposite side (or two or three or more provided they are all in the same compartment). 
For more complex alternative hypotheses the rules that could be laid down become more 
complex and it is easier to note the groups into which the sample points fall. 


I should like to thank Prof. E. S. Pearson for the idea of the second test described here 
and for much helpful criticism. 
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ion of Table la. Probability distribution of z, the number of zero groups, when N sample units 
are randomly arra in TOUPS O r ality 
x test ndoml nged in N groups of equal probability 
lering 
y N 
3 4 5 6 7 8 9 10 ll 
2 
0 | 0-2222 | 0-0937 | 0-0384 | 0-0154 | 0-0061 | 0-0024 | 0-0009 | 0-0004 | 0-0001 
1 | 0-6667 | 0-5625 | 0-3840 | 06-2315 | 0-1285 | 0-0673 | 0-0337 | 0-0163 | 0-0077 
2 | O-1111 | 0-3281 | 0-4800 | 0-5015 | 0-4284 | 0-3196 | 0-2164 | 0-1361 | 0-0808 
3 — 0-0156 | 0-0960 | 0-2315 | 0-3570 | 0-4206 | 0-4131 | 0-3556 | 0-2770 
4 — — 0-0016 | 0-0199 | 0-0768 | 0-1703 | 0-2713 | 0-3451 | 0-3730 
5 _ — — 0-0001 | 0-0032 | 0-0193 | 0-0606 | 0-1286 | 0-2093 
6 — — — — 0-0000 | 0-0004 | 0-0039 | 0-0172 | 0-0479 
7 — | — — — — 0-0000 | 0-0000 | 0-0007 | 0-0040 
8 — — — — — — 0-0000 | 0-0000 | 0-0001 
) 9 — — — — — = — 0-0000 | 0-0000 
10 — — — — — — — — 0-0000 
“4 
} N 
12 13 14 15 16 17 18 19 20 
Zz 
) 
i.e. to 0 | 0-0001 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 
art ate 1 | 0-0035 | 0-0016 | 0-0007 | 0-0003 | 0-0001 | 0-0000 | 0-0000 | 0-0000 | 0-0000 
airesee 2 | 0-0458 | 0:0250 | 0-0132 | 0-0068 | 0-0033 | 0-0017 | 0-0008 | 0-0000 | 0-0000 
rift in 3 | 0-1994 | 0-1348 | 0-0864 | 0-0530 | 0-0313 | 0-0179 | 0-0100 | 0-0052 | 0-0029 
yy the | 4 | 0-3560 | 0:3080 | 0-2461 | 0-1841 | 0-1303 | 0-0880 | 0-0570 | 0-0357 | 0-0216 
using 5 | 02809 | 03255 | 0-3357 | 0-3151 | 0-2735 | 0-2222 | 0-1707 | 0-1248 | 0-0874 
sen at 6 | 0-0988 | 0-1632 | 0-2279 | 0-2784 | 0-3052 | 0-3058 | 0-2839 | 0-2470 | 0-2031 
wile 3 7 | 0-0147 | 0-0380 | 0-0768 | 0-1284 | 0-1847 | 0-2353 | 0-2709 | 0-2863 | 0-2811 
ists In ) 8 | 0-0008 | 0-0038 | 0-0123 | 0-0303 | 0-0602 | 0-1016 | 0-1498 | 0-1981 | 0-2365 
at for 9 | 0-0000 | 0-0001 | 0-0009 | 0-0035 | 0-0103 | 0-0242 | 0-0476 | 0-0809 | 0-1215 
edian = | 10 | 0:0000 | 0-0000 | 0-0000 | 0-0002 | 0-0009 | 0-0030 | 0-0085 | 0-0194 | 0-0378 
aylie |) | 11 | 0:0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0002 | 90-0008 | 0-0026 | 0-0070 
. | 42 =< 0-0000 | 0:0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0002 | 0-0007 
wane), 13 —_ _ 0-0000 | 0:0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 
more 14 — — — 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 
| 15 _ _ _ — 0-0000 | 0-0000 | 0-0000 | 0-0000 | 0-0000 
16 — — — — — 0-0000 | 0-0000 | 0-0000 | 0-0000 
1 here 17 = 2? — — — — 00000 | 0-0000 | 0-0000 
18 — — _ _ - _ — 0-0000 | 0-0000 
19 — _ _ - = — nal 0-0000 
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Two combinatorial tests 


Table 1b. Suggested significance levels for the distribution of z as given in Table la 























N 5 6 7 8 9 10 
Reiect if z i 0 (0-038) 0 (0-015) 0 (0-006) 0 (0-002) <1(0-035) <1 (0-017) 
pen 5 2 4 (0-002) 24(0-020) 25(0-003) 25 (0-020) 25 (0-064) >6 (0-018) 
N 11 12 13 14 15) 16 
Reiect if z i <1 (0-008) <2(0-049) <2(0-027) <2(0-014) <3(0-060) <3 (0-035) 
eject nz 18 |) 56 (0-052) +7 (0-015) +27 (0-042) +8 (0-013) +8 (0-034) >9 (0-011) 
N 17 18 19 20 
2 -. {| <3(0019) <3(0-011) <4(0-041) <4 (0-025) 
Reject if z is 4 >9 (0-027) >9 (0-057) +10 (0-022) > 10 (0-045) 
N.B. The figures in parentheses are the resulting probabilities of wrong rejection. 
Table 4a. Distribution of z, the number of zero growps, in any specified N 
out of a total of 2N compartments 
iN 
1 2 3 4 5 6 7 8 9 10 


















































0 0-5000 | 0-1250 | 0-0278 | 0-0059 | 0-0012 | 0-0002 | 0-0001 | 0-0000 | 0-0000 | 0-0000 
1 0-5000 | 0-6250 | 0-3333 | 0-1289 | 0-0420 | 0-0123 | 0-0033 | 0-0008 | 0-0002 | 0-0001 
2 — | 0-0250 | 0-5139 | 0-4424 | 0-2550 | 0-1163 | 0-0455 | 0-0160 | 0-0052 | 0-0016 
3 — — | 0-1250 | 0-3604 | 0-4380 | 0-3436 | 0-2058 | 0-1026 | 0-0447 | 0-0176 
4 — _ — | 0-0625 | 0-2326 | 0-3692 | 0-3715 | 0-2793 | 0-1712 | 0-0901 
5 — — — — | 0-0312 | 0-1427 | 0-2813 | 0-3484 | 0-3179 | 0-2332 
6 — — — _ — | 0-0156 | 0-0846 | 0-2000 | 0-2958 | 0-3194 
7 — — _ — — — | 0-0078 | 0-0489 | 0-1353 | 0-2334 
~ — — — — — _ — | 0-0039 | 0-0278 | 0-0881 
9 — — _ — _ ~~ _ — | 0-0020 | 0-0156 
10 Sete a mes oer Led _ a ot — | 0-0010 
Table 4b. Suggested significance levels from Table 4a 
Sample size 3 os 5 6 7 8 9 10 
Reject if number of zeroes is 0 <l <1 <2 <2 <3 <3 


Probability of wrong rejection 


Reject if number of zeroes is 


Probability of wrong rejection 





0 
0-0278 | 0-0059 | 0-0432 





4 5 
— 0-0625 | 0-0312 

















0-0168 | 0-0501 | 0-0193 


29 


0-0528 | 0-0298 | 0-0165 
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MAXIMUM LIKELIHOOD AND THE EFFICIENCY OF THE 
METHOD OF MOMENTS 


By L. R. SHENTON 


1. INTRODUCTION 


One of the practical difficulties in estimation by maximum likelihood arises from the fact 
that, except in special cases, the resulting equations are complicated and not easily solved. 
The present paper approaches this problem by deriving an expansion based on moment 
approximations to the likelihood equations. These are also not easy to solve explicitly, but 
they furnish a method of deriving the efficiency of the method of moments in terms of an 
expansion of the determinant of the information matrix. The efficiency of moment fitting 
as applied to Pearson’s distributions has been discussed by Fisher (1921), who more recently 
treated the case of the negative binomial (Fisher, 1941). 


2. THE LIKELIHOOD EQUATIONS AND ORTHOGONAL POLYNOMIALS 


Let P(x; 9,69, ...,9,) be the probability of the variate x, depending on s parameters 6; 
(j = 1, 2,...,8). We shall assume that P(x; 6;) possesses first derivatives with respect to the 
6,, and that its moments yw, and their first derivatives exist and are finite. In this case 
(Kacmarz & Steinhaus, 1935) it is possible to construct a system of polynomials 


q(t) = YA,;2/ (A,,+0, r = 0,1, 2,...), (1) 
j=0 
which are orthogonal with respect to P(x; @), satisfying 

[oa Pee A)dx=0 (r+ _ (2) 

+0 (r=s), 

or Xq,-q,P(x;9) =90 (r+s), 
} (3) 

+0 (r=s), 


where the integral includes finite summation for a discrete variate. These may be replaced by 


[ade P(x; 0)dz =0 (r>8), 
+0 (r=s), 


with a similar expression for (3), where ¢,(2:) is an arbitrary polynomial of degree j. 
It is convenient to assume for q, the form 


a2) = SB —Hj) (= 1,2,..0599= Ds (4) 


where ji, is the sth crude moment of P(x; 8). 
Choosing ¢,(x) = x/, the orthogonality conditions lead to 


Bra Mare Mabe) =0 (k=1,2,...,r—1). (5) 


“ fare: O)da+ 3 Bodine HH) = 0. (6) 
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Writing m, for sample moments, we have 


N cov (m;, mi) = pis..— Write = (1,8) 
where N is the number in the sample, so that from (4) and (5) 


say, 








wp, tp, x fy | 
(r, 1) (r—1,1) (1,1) (r—1,1) (1,1) 
G2) =) (2) (r—1,2) (2) |*| (1,2) (2) |? 
(r,r—1) (r—1,r—1) (1,r—1) | (r—1,r—1) (1,r-—1) 
and from (5) and (6) 
| (r, 1) (r—1,1) (1,1) 
[22 P(e; 6) de = (—y] (7,2) (r-1,2) (1,2) || (r-1,1) (1,1) 
(r,r) (r-1,7) (lr) } | (r-ir-1) ... (1,r—1) 
=¢, say. 
Suppose further that af = *kUete (j = 1,2,...,8), 
where P,= P(x; 0). Then 
hale (j = 1;2,...,8; 7 = 0,1,...) 
oP, 
00; x 2 & Bale ~ phd 
-¥B bs x*Pde—- 3 u.B 5g, | Pad 
Pra "* 00, x gn k "* 00, x 
OM, OMy—1 ony 
06; 00; 06; 
(r, 1) (r—1,1) (1,1) (r—1, 1) (1,1) 
(r, 2) (r—1, 2) (1, 2) (r—1, 2) (1, 2) 
(r,r—1) (r—1,r—1) (1, r—1) (r—1,r—1) (1,r—1) 
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(10) 


(11) 


(12) 


since = Aig dx = 0 provided the range of values of x is independent of the 0,;, and where we 


have al it is permissible to differentiate under the integration sign. Clearly C,, = 0. 
Now the maximum likelihood equations for the estimation of the parameters 0, are 


x’ 


Q 
99,082 = ° or sy 3 Se 0 


1 oP, 


P, a0, (J = 1, 2,...,8), 


the summation being over the sample. 
From (9) we have the following formal expansion to determine optimum statistics: 











Hy My—fy My — My 
—H_ ™— Hh (3,1) (21) (1,1) 
nig | @) (3,2) (2,2) (1,2) 
aw (1,1) _ (2,1) (1,1) 
(2,2) (1,2) 
(j = 1,2, 


er 8 


(13) 


(7) 


(8) 


(12) 


13) 


L. R. SHENTON 113 


where C;, is given by (12), and (k,1)=N cov (mj,,m;). The equations (13) will in general be 
very difficult to solve, and from a practical point of view of doubtful value. To use them at 
all we must curtail the series at a certain stage and assume that the remainders are negligible. 
Further, since the sampling variance of m, is large for s > 4 or 5, the inclusion of additional 
terms to improve mathematical accuracy will partly defeat its own object. The most suitable 
application would appear to be to large samples when the number of parameters is one or 
two; even in this case the usual method of using an inefficient estimator and successively 
approximating from the likelihood equation may be simpler. We turn to the main object of 
the paper which is an expansion for the efficiency of the method of moments. 


3. EFFICIENCY OF THE METHOD OF MOMENTS 


Using the first s sample moments to estimate the s parameters, we have (Fisher, 1941) for 
the efficiency E, 


1_i|p - 1 OP,0P,] var@,  cov(0,,0,) ... cov (0,,9,) 
E; | P2060; 00,4) | cov (6,91) var (0, ) .. cov (9, 8,) 
cov ,,3,) cov é,, 8.) ...  var(@,) 


_| pf 1 oP aR AO p00) 
=| | pi29, 20, ]||loov emma | Creacamers 


where @, are consistent estimates of iy obtained from the sample moments, [v,,] is a matrix 


dias (81,95, ---49,) . 
with j, k = 1,2,...,8 and ——)—*——" = 
. O( M45 Megs -++s Me) . oh) 














(14) 





is a Jacobian. 


But from (9) we have 





1 aP,aP,\ _ (( % 2 
(Paseo) ~ [( E,Gmtn)( 3S) Pet 

— 2 Ca Geada (j,k = :. 2, vege (15) 
Hence from (14) and (15) 
7, ~ 1b2---$6(57) || 3 GaCeads || 

36 . Cy Cx at Cu Cy Cx =o 2 Aa 1 C41, 1 P 
= ati Cre Cra» On| gy... Gyt| Cis Cre --- Chara Corns | bibs. bsaders 
Cyp Cog «+» Cog Cis Cog C. 1,2 Cas 
Cy Cu ial Co43,1 Cy P 
+ Cre Coa Cos1,2 Coa $192: ~ Psa Peri Pst ++ ’ (16) 


Cy, oR Onis, 2 Gn, 
where we have used 00/0’ for the Jacobian appearing in (14), and where the determinants 


are of order s x s whose terms consist of all distinct combinations of s from 1, 2, 3,..., etc.. 
used in the determinant 


Chr Cn Cr 7 Cw P 
Cya Cra Ca + Cw Py PaPr-+- Pws 
Cg G,, G., ‘— Cvs 


with p, q, r, etc., as positive iia 
Biometrika 37 8 
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The first term of (16) after elementary operations on rows and columns of the determinant 


reduces to 
tate $(ae) (aig a9) Pe B= 


Since ¢, = iE P,dz and P, is essentially positive for the range of values of x for which it is 


defined, it is clear that ¢, is positive. Hence (16) consists of a series of positive terms, the first 
few of which will provide a lower bound to 1/H; or upper bound to H;. In general it is quite 
sufficient to use the first two or three terms. 


4. APPLICATION 


As an example of the foregoing we take a ‘hypergeometric’ distribution recently discussed 
by J. G. Skellam (1948). From it, as Skellam shows, the negative binomial distribution may 
be found as a limiting case, for which the efficiency of the method of moments has been given. 
Taking the binomial distribution 


n\ . 
(a) = (")par, 
where the probability varies according to the law 


o(p) = kp**(1—p)** (0<p<)), 


with k a constant and a and f any real positive values, Skellam arrives at the probability 

function 

(B+n—x—1)"™® 
(a+ f+n—1)™ 





P(x; a, f) = (") (a+a—1) (17) 





with (*) ee = (nae 1) and N@=N(N-)...(N—2+). 
It is assumed that n is a known positive integer, so that there are two parameters a and £ 
for estimation. If the value of n is also to be estimated the derivation of E, will be slightly 
more complicated. The distribution (17) may be regarded as a negative hypergeometric, in 
the sense that in the usual form of the hypergeometric probability distribution 


wee) = (7) cp) Waye-20 


we need only put Np = —a, Nq = —f. The negative binomial follows by putting f = n/c 
and letting noo. Using known properties of the hypergeometric distribution and its 
associated orthogonal polynomials (Aitken & Gonin, 1935), we have 








> Pt = F(-n,a;0+f; 1-2), (18) 
z=0 
q(x) = F(n—r+1, —a—r+1; -a—f-2r+2; —A,)®, (19) 
m™(a+r—1))(B+r—1)%(a+f+r+n—1) 

— 20 
tis (a+ 8+ 2r— 1) (a+ B+ 2r—2) >), (9) 

2 

where F(a,b; c;d) = 54 ee tet a 


lle 2!c(c+ 1) 


and A, Uy = U p44 — Uy. 


Pp 


it 


8c 





‘minant 


ich it is 
the first 
is quite 


scussed 
on may 
n given. 


ability 


(17) 


x and f 
slightly 
atric, in 


B = nlc 
and its 
(18) 
(19) 


(20) 
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aP,- oP 
Putting aa = 2 4,9,F 2 Be = >B qd P 
r 


it may be seen that A, = B, = 0, 

a (—)rtn® (B+r—1)(r—1)! P 

Arte= (a+ B+ 2r—2) (a+ B+r—1)’ a = 
Using (18) for the factorial moments we find 


(May Migs) _ O(/44, a) —n.n®@apo 
O(a,B) a(az, B) ne (a+Platpriy? say, 


so that estimating a and / by the first two factorial moments of the sample, we have from 
(20), (21) and (16) 


—27 (a+r—1)(r—1)! 


(a+ B+ 2r—2) (a+ fP+r— 1)?" (21) 





























1 1 A, A, |? 
r 1+ Soo B, = “bidet +3 B, o “baGat B, 7 ord.+.| 
_ 14 Hm=2) (a+ B+ 1) (a+ 8+3)(a+8+5) (af? 





3(a + 2) (B+ 2) (a+ f+ 2)*(n+a+ 8+ 2) 
2(n—1)?(a+1)(8+1)(a+f)(a+8+4)? (a+f+5) 
3(a + 2) (B+ 2) (a+ P41)? (a+f+4+ 2)*(n+a+8 +4 2)@ 
3(n — 2) (a+ B+ 1) (a+ 847) [(a+3)+ (8 +3)%P 
(a+ 3) (8+ 3)? (a+ 8+ 2)3 (a+ f+3)3 (n+a+84+3)® 
From (22) it can be seen that: 








(22) 


8 
B. B, 
where K does not contain n, so that for all admissible suffixes except r,s = 1, 2, we see that 
(n — 2) is a factor. Hence when n = 2, E, = 1,80 that the moment solution is efficient, a fact 
which is otherwise obvious. 
(b) If a and £ are both small then 


(a) The general term associated with (r +8) is of the form Knn™/n?(n—1), 








T (n—2)(n—3) 
18 (n+ 2) (n+3) 


which for practical values of n, say < 20, suggests that H may not be below 80 %. 
(c) If « is small, # not small, say > 1, then 


Bt = 142= ae (B+ 1)(B+3)(B+5) 
3(n + B+ 2) (B+ 2)5 ; 
which very rarely reduces EL, below 70 %. 

(2) Ifwand fare both large, the relative degrees in « and £ of the numerators and denomin- 
ators suggest high efficiency. 

Thus the discrete ‘hypergeometric’ type distribution (17), depending on two parameters 
a, 8, with range n (assumed known), is simple to fit by the first two factorial moments, and 
this method of estimating the parameters rarely has low efficiency. (It is suggested that the 
first four terms of (22) should be used in any practical case.) We may mention that Mood 
(1943) gives this distribution in connexion with sampling inspection plans, and remarks on 
some of its properties. 

Skellam’s example on the secondary association of chromosomes in Brassica is 





No. of associations x= 0 1 2.3 
Frequency 32 103 122 80 
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for which Skellam finds: 

(a) a = 6-168, £8 = 4-455 by moments, 

(6) ‘improved’ maximum likelihood estimates, 2 = 6-12, B = 4-42, 

(c) x? = 0-76 for both methods of fitting. 

It is clear that the improvement introduced by maximum likelihood methods is negligible, 
indicating high efficiency for the method of moments. Putting « = 6, # = 4-5, n = 3 in (22), 
the first four terms give Z,; = 1/1-001 in good agreement. 

It is of interest to notice the form of (22) when we take ff = n/c in (17) and let n> 00, so 
that the distribution is now the negative binomial. We find 

x atte - 4c . 3c? ‘ 

E; 3(1+c)(a+2) (l+c)?(a+3)? ~” 
as given by Fisher (1941) by a different method. Moreover, the likelihood equations (13) 
take the form 








ES log P, = L'(x—ac)/e(1+c) = 0, 
,@ _ sf a(z) qo(X) s(x) rf mM 9 
* 7g, 06 Fe sl (0 (a+ 1)®(1+e)?* 3a +2)®(1+c)8 sie Hei (23) 
where q(x) = & ~ Hele+r— 1) aD 4+ tle C(atr—1jPr-9)_..., 


The first two terms of (23) together with &’(x— ac) = 0 correspond to the moment solution; 
we may use the first three terms to ‘improve’ this solution, neglecting the remainder which 
in any case consists of terms whose expectation is zero. Taking an example given by Haldane 


(1941): yg = .. 228 ieee oe... 9 28% 
Frequency 167 267 271 185 111 61 27 8 3 1 1096 
for which the first three factorial moments are 
My) = 2°156,934, mq) = 5-100,365, mg = 12-651,460, 
we find from the first three terms of (23) 
1-344,003a3 — 7°805,548a? — 40-625, 167a — 140-487,797 = 0, 
a solution of which is « = 9-918; Haldane gives a = 9-900 as the maximum likelihood solution 
and a = 10-44 as the moment solution, so that the use of (23) does in this case lead to an 
improvement. It would appear desirable to know under what conditions series such as (23) 


converge rapidly, and whether it is not just those cases for which the efficiency of moment 
fitting is low which give slow convergence. 


In conclusion I wish to express my thanks to Prof. M.S. Bartlett for helpful criticisms. 
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FIDUCIAL LIMITS OF THE PARAMETER OF A 
DISCONTINUOUS DISTRIBUTION 


By W. L. STEVENS* 


1. THE PROBLEM 


1-1. It has long been realized that methods of interval estimation which can be used 
successfully in the case of continuous distributions encounter a special kind of difficulty 
when we attempt to apply them to a discontinuous distribution such as the binomial or the 
Poisson. This difficulty has been expressed in different ways by different writers, their choice 
of words being mainly influenced by whether they are using Fisher’s concept of fiducial 
probability or Neyman’s of confidence intervals. While these approaches are said to be 
fundamentally different, their applications to the uniparametric case are so closely linked 
that an argument in terms of the one can usually be translated in terms of the other. We shall 
accordingly not hesitate to express our results in the languages of both theories. 

We may begin with the simplest example of a discrete distribution—the binomial. If 
the probability of an event is 7, the probability that it will occur f times in n trials is 


n! 
gf, 7) = Fone | a es a (1-11) 
The probability that it will happen f or more times is 
GUf,m) = Eglr,7). (1-12) 
r=f 


If in a given experiment it did in fact happen f times, we may define 7,(f), corresponding 
to any probability level, F,, as the root of the equation 


G(f,m) = Py (1-13) 
When f = 0, we define 7(0) = 0. 
Then it can readily be shown that if f+ 0, and if 
1 <7; 
then G(f,7)< FB, 


Thus any hypothesis which puts 7 <7, is rejected at the F, level of significance in favour 
of a higher value of 7. Hence 7, is a lower limit to 7 and may conveniently be termed the 
lower P, limit of 7. At the chosen level of significance, we accordingly write either 

17>, OF 72M. 
Similarly, we may define 7,(f), the upper P, limit of 7, as the root of the equation 
G(f+1,m) =1-P, (1-14) 
implying that P, = probability that r is f or fewer. 

When f = n, we define 7,(n) = 1. We then write either 7 <7, or 7 <7,. Combining the two 

inequalities, we therefore have a statement, either | 
My<7<7, OF M<CTM<KTN, 


* Universidade de Sio Paulo, Faculdade de Ciéncias Econémicas, Rua Vila Nova, 268, SAo Paulo, 
Brazil. 
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corresponding to any pair of probability levels, subject to the condition that Pj+ PR, <1. 
(P, and P, are usually but not necessarily equal.) 

Notice that in calculating either limit the probability of the actual result, f observed in n, 
is included. This probability is of course finite, whereas if the observations were drawn from 
a continuous distribution the probability of the actual result would be an infinitesimal. 
It is from this difference that all the trouble springs. 


1-2. Charts and tables. Charts of the limits of 7 as functions of n and f/n for Py = P, = 4% 
and 24% were published by Clopper & Pearson (1934). The present writer noticed that if 
we tabulate nz instead of 2 and use f and f/n instead of n and f/n, we can greatly facilitate 
interpolation, thus covering in a condensed table all the region where the normal approxi- 
mation is unsatisfactory. Our table, which covers the range f = 0-15, f/n = 0-1 and P, or 
P, = 10, 2-5 and 0-5 % appeared in the second edition of Fisher & Yates. 

1:3. The two fiducial distributions. Let us now see what happens when we attempt to define 
the fiducial distribution of 7. Differentiating G(f,7) with respect to 7, we have 











0 
h,(7) dn = OF) ay = eGo (1 —m1)"-F 7f-1 dn. (1:31) 
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Fig. 1. The pair of fiducial distributions associated with ‘3 in 10’. 


This is an admissible probability distribution, since its integral between 0 and 1 is unity. 
(See left curve in Fig. 1 for the case n = 10 and f = 3.) Moreover, if we write 


” helm) de = P,, (1-32) 
0 


the value of 7 satisfying this equation is in fact the lower P, limit of 7. If only we could also 
obtain the upper P, limit by solving 


I " helm) dx = 1—P,, (1-33) 
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then we could legitimately call h,(7) the fiducial distribution of 7. But, of course, we can do 
no such thing. We have to define a second distribution of 7, 


0G(f+ 1,7) n! 
in 7-H 


(See right curve in Fig. 1.) The upper P, limit of 7 is then the 7, which satisfies the equation 


h,(1)dn = 





(1—7)"-J-1 nS dr. (1-34) 


[rum dn =1-P,. (1-35) 


Thus we see that the unique fiducial distribution obtainable from a continuous distribution 
(where a sufficient statistic exists) becomes resolved in the discrete case into a pair of 
distributions. 

It is a matter of taste, up to this point in the argument, whether we choose to say that there 
is no fiducial distribution associated with the result, f in n, or whether we say that each result 
has associated with it a unique pair of fiducial distributions. At any rate, these two between 
them perform the same service as is performed by the unique fiducial distribution in the 
continuous case, namely, that of supplying limits to the parameter, corresponding to any 
pair of significance levels. The only extra rule we need is the simple one, that when finding 
lower limits we use h,(77) and when upper limits, h,(7). 

1-4. Fisher's discussion of the problem. The peculiar nature of the fiducial argument when 
applied to discontinuous data has been expressed differently by Fisher (1935). He was there 
discussing a fourfold table, showing twins of convicts classified as convicted or not-con- 
victed and monozygotic or dizygotic. The relevant parameter is the cross-product of the 
cellular probabilities 


y = 77474 
2M. 


but it is evident that all his remarks are applicable to the example of the binomial! distribu- 

tion. The passage must be quoted: 
...We may thus infer that the observations differ significantly at the 1 % level of sig- 
nificance, from any hypothesis which makes y greater than 0-48 .... This is not a pro- 
bability statement about y. It is a formally precise statement of the results of applying 
tests of significance. If, however, the data had been continuous in distribution, on the 
hypothesis considered, it would have been equivalent to the statement that the fiducial 
probability that y exceeds 0-48 is just one chance in a hundred. With discontinuous data, 
however, the fiducial argument only leads to the result that this probability does not exceed 
0-01. We have a statement of inequality, and not one of equality. It is not obvious in 
such cases, that, of the two forms of statement possible, the one explicitly framed in terms 
of probability has any practical advantage. The reason why the fiducial statement loses 
its precision with discontinuous data is that the frequencies in our table make no dis- 
tinction between a case in which two dizygotic convicts were only just convicted, perhaps 
on venial charges, or as first offenders, while the remaining 15 had characters above 
suspicion, and an equally possible case in which the two convicts were hardened offenders, 
and some at least of the remaining 15 had barely escaped conviction. If we knew where we 
stood in the range of possibilities represented by these two examples, and had similar 
information with respect to the monozygotic twins, the fiducial statements derivable 
from the data would regain their exactitude. 
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The explanation here advanced for the loss of precision in the fiducial statement may strike 
the reader as somewhat metaphysical. Although one can think of a continuous phenomenon 
underlying the discrete classification into convicted and not-convicted, yet in other 
examples such a notion would at once ring a false note. For example, if the classification is 
made according to whether the individual possesses or not a certain gene at a certain locus, 
there can surely be no underlying phenomenon representing all gradations between posses- 
sing and not possessing the gene? Be that as it may, it is curious that the method which we 
are going to develop can be linked up in a striking way with Fisher’s concept of underlying 
continuity. 

1:5. Confidence intervals for 77. Let us next see how the peculiarity of the discontinuous 
distribution problem reveals itself when we write in terms of confidence intervals. Let us 
suppose that we make it a rule always to calculate the lower P, limit and then to state that 

T™>T%, OF 72M. 
In following either rule, we shall sometimes make a true statement and sometimes a false 
one. We can therefore define 


Prob{m>7,} or Prob{7>7,} 
as the limit of 


number of times the statement is correct 
number of applications of the rule 


as the number of applications tends to infinity. 





As soon as the confidence interval argument was applied to the binomial distribution, it 
was realized, and in fact pointed out in Clopper & Pearson, that 


Prob{7>7}>1—P, and Prob{m>7,}>1-—P,. (1-51) 


This probability is a function of the parameter 7. The graph of the complementary function, 
Prob {7 < m5} for the case n = 10 and P, = 10 %, is given in Fig. 2. 
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Fig. 2. Probability {7<7,} when n = 10. 


The curve shows discontinuities at the n points, 
7(1), 7(2), 29° 7(N), 
and it is only at these points that Prob{7<z7,} = P, and hence Prob{7>z7,} = 1—F. 


Elsewhere, Prob {7 <7} can differ very gravely from 10%. Leaving out the extreme cases 


of f = 0 and f = 10 where we might have expected trouble, we are still left with a variation 
from } to 10%. 
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Similarly, it can be shown that, having calculated an upper P, limit, 7,, then 
Prob{a<m}2>1—P, and Prob{m<a2,}>1-A. (1-52) 
The equality sign holds only at the n points of discontinuity, 
7,(0), 7,(2),  ...,  m4(m—1). 
Combining (1-51) and (1-52), we conclude that 


Penh eat (1-53) 


and Prob {7,5 <7 <7,}>1-P,—f,. 
We can say further that there ‘always’* exists a positive quantity D greater than zero, 
such that Prob {1)<a<7,}>1+D-—P,-F,. (1-54) 


Now the use of 1— P,—P, (the confidence coefficient) as a measure of our confidence in the 
assertion, 7) < 7 <7;, has been justified by two lines of argument: (a) that in the limit, when 
nis large, the inequality sign may be replaced by the equality sign, and (6) that the calculated 
confidence coefficient is necessarily conservative, i.e. on the ‘safe side’, because the true 
probability of 7 being between the limits is ‘always’ greater than is stated. The first type of 
argument need not be taken too seriously, since it amounts to no more than saying that any 
small-sample test tends in the limit to the corresponding large-sample test, which, although 
true, would hardly be a reason for ignoring the small sample test if it were avaiiable. The 
second type of justification is a much more serious matter and, in the view of the present 
writer, is completely invalid. 

It is the very basis of any theory of estimation, that the statistician shall be permitted 
to be wrong a certain proportion of times. Working within that permitted proportion, it is 
his job to find a pair of limits as narrow as he can possibly make them. If, however, when he 
presents us with his calculated limits, he says that his probability of being wrong is less than 
his permitted probability, we can only reply that his limits are unnecessarily wide and that 
he should narrow them until he is running the stipulated risk. Thus we reach the important, 
if at first sight paradoxical conclusion, that it is a statistician’s duty to be wrong the stated 
proportion of times, and failure to reach this proportion is equivalent to using an inefficient 
in place of an efficient method of estimation. 

Of course, this criticism begs the fundamental question of whether we can, while still not 
exceeding the stipulated probabilities of being wrong at either limit, find an interval lying 
within the interval found by the usual method. We shall now show that we can do this and 
more. In fact, it is possible to find a pair of limits 7) and 7, such that 


Prob {7 >7,} = 1—P, 

Prob {7 <7} = 1-AP, 
and hence Prob {7,<7<7,} = 1-P,-AP, (1-55) 
and these limits will ‘always’ be wholly inside the limits customarily calculated. This means 


that we can recover for the discontinuous problem the exact type of fiducial or confidence 
interval statement which is possible in continuous problems. 


* We shall use inverted commas and write ‘always’ when we mean that the probability of the event 
is unity but that it need not happen. Similarly, we shall say an event ‘never’ happens when it can happen 
but its probability is zero. Thus if x is drawn at random from the rectangular distribution 0<2<1, we 
say that x is ‘always’ greater than zero, ‘never’ equal to zero, but never equal to unity. 
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2. THE SOLUTION 


2:1. Suppose that in n trials the event has occurred f times. Then define a variable y by 


the equation y =ft+2, (2-11) 


where x is any number chosen at random from the rectangular distribution, 0 < x < 1. (This 
means, in practice, that z is a decimal point followed by a sequence of digits taken from a 
table of random numbers.) The quantity y is accordingly any real number in the range 
0<y<n+1. We may also note that y uniquely determines f and z, since f is the whole and 
y the fractional part of y. 

Since y is the sum of two quantities, each drawn from a known distribution, it follows 
that its own distribution is determinate, and can in fact be found without difficulty. Now 
since y uniquely determines f, it is evidently a sufficient statistic for 7. We therefore need not 
hesitate to apply the fiducial probability argument. Thus, if 


y=ft+« 
and Yo = fotXo, 
Prob {y > yo} = Prob {f > f,} + Prob {f =f,} Prob {a > x,} 

= G(fot 1,7) +9(fos 7) (1-29) 

= %G(fo+ 1,7) +(1—2%9) G( fo, 7) (2-12) 
Differentiating this probability with respect to 7, and aie the suffices on f and x, we 
thus define a distribution function 

h,(1) dm = xh,(m) dn + (1 —2) h, (7) dz, (2-13) 

where h,(77) and h,(7) are the functions already defined in (1-31) and (1-34). 

We propose to call h,(77) dz the fiducial distribution of 7. Notice, however, that it is defined 
only after we have drawn our value of x. Given merely the number f, then. there exists an 
infinite continuum of such distributions ranging between the pair of distributions ho(7) dz 
and h,(7)dm which appeared in the earlier discussion. Now it is essential that the fiducial 
distribution of a parameter should be unique. This, however, can be assured by the following 
simple rule: 

When any experiment has been performed (or series of observations taken), the investi- 
gator is allowed once and once only to select, at random, his value of x; the distribution thus 
determined will be called the fiducial distribution of 7, and neither he nor anyone else is 
permitted another drawing of the number z. 

As a result of this rule, we find that a fiducial distribution is uniquely determined for each 
experiment, though not for each value of f. Now it will readily be seen that the fiducial limits 
found by integrating h,(7) dm ‘always’ lie waolly inside the fiducial limits found by the usual 
method. Moreover, since y is a continuous variable, the statements in fiducial probability 
become statements of equality instead of statements of inequality. 


2:2. Demonstration. To clarify these remarks, let us first examine the functional relation 
between y and 7. Corresponding to any probability P (for a lower limit) or 1 — P (for an upper 
limit), we have the following equation relating y and 7: 

aG(f+1,7)+(1—x)G(f,7) = P. (2-21) 
Differentiating totally with respect to x, we get 
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d 
Hence —g(f) +h(m) ~, (2-22) 
Hence dz/dx is everywhere finite and positive. 
However, if y< 1—P, ie. if f = 0 and x<1—P, the equation becomes 


(l—7)" = (1—P)/z, 
thus yielding a negative value for 7. We must therefore define 7 as zero, when y<1—P. 


Similarly, we define 7 as unity when y>n+1—P. 
Next we note that as x—> 1 the equation tends to 
G(f+1,7) =P, 

which is the equation appropriate to y = f+ 1. Hence zis a continuous function of y, although 
the derivative dz/dy is discontinuous at the integral values of y. The graph of 7 against y is 
in fact a series of ascending loops, like a telegraph wire going up a mountain side. We con- 
clude therefore that y uniquely determines 7 and that 7, if not equal to zero or unity, also 
uniquely determines y. Under this same restriction, we also see that m(y) and y(7) are ever- 
increasing functions of each other. Moreover, since the lower limit, as usually calculated, 
can be found from the method here proposed by putting x = 0, it follows that the new method 
‘always’ yields a higher value for the lower limit. Similarly, it can be shown that it yields 
a lower value for the upper limit. 

Now let 7 (0<7 <1) represent the true parametric value, and let y = y(7) be the corre- 
sponding y at a chosen level P,. Suppose we draw at random a sample of n observations.and 
encounter the event f, times in the sample. To this f, we add our randomly chosen z, in order 
to produce y, which then uniquely determines 7, the lower FP, limit. In repeated applica- 
tions of this procedure, we may accordingly define 

Prob {77 < 7}. 
However, 7, <7 implies y,<y. Hence 


Prob {77, < 7} = Prob {y,< y} = 1— Prob {y, >y} = 1—-F. (2-23) 
Hence Prob {7, <7}, in the sense of the Neyman-Pearson theory, is exactly equal to 1 — F,. 
Since y is continuous it is immaterial whether we write 
Prob{7)<7}=1-—P, or Prob{a)<7} = 1-—F. 
Similarly, if 7, is the upper P, limit, then 


Prob {7 < 7,} = Prob {7 <7,} = 1—FP,. (2-24) 
Combining the two statements, we therefore have 
Prob {1 <7 <7} = Prob{m)<7<7m,} = 1-R,—-F. (2-25) 


These equations hold for all values of 7 in the open interval 0 <7 < 1. Is it possible to close 
the interval? Yes, if we adopt the following rules: 
When 7,=0, wemust write O<7. 
When 7,=1, wemustwrite l<z. 
When 7,=0, wemust write 7<0. 
When 7,=1, wemust write m<1. 
Under these rules, it can be shown that the equations are true, even for 7 = 0 and 7 = 1. 


However, the solution is a little artificial, since in two instances we have to make statements 
which we know to be false. Perhaps the proper answer is that in practice we can rule out the 
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possibility of either 7 = 0 or 7 = 1, for if, in fact, we thought that 7 was small and possibly 
zero (or large and possibly unity) we would have employed a different experimental tech- 
nique, namely that of inverse sampling. 


2:3. Alternative solutions. Once the idea of introducing a random variate has been 
admitted, one may inquire whether it need have been drawn from a rectangular distribution. 
Could it not have been drawn from some other distribution, and if so, could we not find some 
distribution which would result in yet narrower limits? 

Suppose z to be drawn from any continuous distribution, j(z) dz, over any range. Then we 
may consider the joint distribution of the pair of sampling variables, f and z. Let us say, 


conventionally, that (f,2) > (for Zo) 
means that either f>fo 
or f=f, and z>z%. 
From this we have 
. " 
Prob {(f, 2) > (fo, 2o)} = I jle) dz Gf, 1,1) + | j(2) dz G( fo, 7). (2°31) 


Differentiating with respect to 7 and removing the suffices, we would again have a fiducial 
distribution of 7, which might be offered as an alternative to h,(7) dz. 

However, a moment’s thought will show that this method yields the same solution in a 
different guise. In order to draw z, at random from j(z)dz we would have to select z, at 
random from the rectangular distribution 0 < x, < 1, and then solve the equation 


mo 
t= | j(z) dz. (2-32) 
Replacing the integrals in equation (2-31), we obtain 
Prob {(f,2) > (fo: o)} = to@(fo+ 1, m) + (1 — 2%) G( fy, 7). (2°33) 


This is the same equation as we used before (2-12). Hence we would obtain the same fiducial 
distributions with the same frequency, the only difference being that they would be differ- 
ently labelled. 

On the other hand, let us consider what happens when the distribution from which we 
draw z contains points of concentration, e.g. a point z = Z, where Prob {z = Z} = a, a finite 
quantity. If then we write & 

t= | j (z) dz, 


there will be a one-one relation between x, and z, everywhere except when z, = Z, in which 
point there is a series of values of x, X <x)< X +«, corresponding to the one value of zp. 
As a result, we find that in this range of x, the lower limit remains constant at the value 
n(f+X), ie. instead of continuing to rise smoothly, the graph of 7, against x, runs hori- 
zontally for a space. Within this interval, it is evident that the calculated lower limits will 
‘always’ be below those found from the rectangular distribution. It can also be shown that 
the inequality sign would have to be returned to the fiducial probability statement if the 
distribution had points of concentration. 

Since we have now shown that alternative methods will either yield the same result, or 
a result which is in two respects less satisfactory, we conclude that we were justified in calling 
h,(7) dm the fiducial distribution of 7. 
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2-4. ‘Underlying continuity. We have seen that the method here proposed replaces 
integral values of fin the range 0 < f <n, by the continuous variable y in the range 0 <y<n+1. 
We notice at once the link with Fisher’s notion (quoted earlier) of the discrete variable 
being merely an incomplete manifestation of a continuous phenomenon. At the same time, 
we must emphasize that the method does not imply, nor does it rest on any idea of, under- 
lying continuity. This is proved by the discussion of the preceding section, which showed 
that the x could be drawn from any continuous distribution. Nevertheless, it is interesting 
that the method, in its simplest form, is expressible in terms of a continuous variable over 
the range of f. 

One should also notice here a similarity with a method proposed by Fisher (1935) for 
recovering exact fiducial statements when estimating bacterial density by the dilution 
method. If the dilution ratio is r, Fisher showed that the fiducial statements may be made 
exact if the first dilution ratio is taken as r* instead of r, where z is drawn at random between 
0 and 1. There is, however, this essential difference: in Fisher’s example a random element is 
introduced before the experiment is performed, whereas here we propose the introduction 
of a random element after the experiment is completed. 


2:5. Choice of the x for different limits. A question which may be asked is whether, when 
calculating a number of limits, we should select the x once and use it for all limits, or whether 
we can select a different x for each limit. For the purpose of defining a fiducial distribution, 
it is obvious that x must be chosen once only. On the other hand, if we wish to determine 
one or more confidence intervals, we may choose, at random, a fresh x for every limit. The 
intervals so determined will still be genuine confidence interva!s in the sense used by Neyman. 
Nevertheless, it should not be overlooked that such a procedure can lead to paradoxical 
results. Thus we might find a 90 ° confidence interval lying wholly inside an 89 % confidence 
interval, i.e. we would have to attach more confidence to the more precise statement. 
Paradoxical though it may sound, the result would be genuine; one would, however, be 
obliged to make both statements in order to maintain the right proportions of true statements 
in the long run. Still one would not like to be the statistician who is called upon to explain 
such a conundrum to a factory manager who has merely been inquiring into the percentage 
of defective articles in production! Perhaps it would be wise to adopt the rule that the same 
a is to be used for all limits (in any given experiment), thus bringing the confidence intervals 
into line with the fiducial intervals. 


3. APPLICATION 


3-1. There is no particular obstacle, except time, to tabulating the proposed solution, 
as applied to the problem of the binomial distribution, or indeed to any other discontinuous 
distribution. Table 1 gives a sample tabulation for the binomial with index = 10. Since the 
fiducial distribution is now unambiguous, the percentile points are more logically labelled 
continuously from 0 to 100 %. The upper 10 % limit is of course tabled under 90 %. 

Thus suppose 3 events were encountered in 10 trials. A table of random numbers begins: 
337 .... We round this to 34 and enter the table with f = 3 and x = 0-34, finding the upper 
and lower 10 % limits 13-1<17<49-4 (%). 


For comparison, the usual method gives the wider limits, 
1l6<7<55:2 (%). 
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Tabie 1. Fiducial limits of the parameter, 7 (°%), of a binomial distribution 


Ten, fifty and ninety percentile points for n= 10 and f=0-10. 











f=0 f= j=2 
x x 
10 50 90 10 50 90 10 50 90 

0-0 0 0 1-05 6-7 20-6 5°45 16-2 33-7 0-0 
0-1 0 0 1-16 75 22-5 5°73 17-1 35-3 0-1 
0-2 0 6-7 1-31 8-4 24-3 6-07 18-0 36-8 0-2 
0-3 | 0 10-4 1-48 9-3 26-0 6-46 19-0 38-1 0-3 

)- 0 13-0 1-72 10-2 27-5 6-91 19-9 39-4 0-4 


==) 
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oooco ooooo 
































0-5 0 14-9 2-01 11-] 28-9 7-4 20-9 40-6 0-5 

0-6 179 | 164 | 239 | 121 | 301 | 80 21-9 | 41-7 | 06 

0-7 3-31 17-7 2°87 } 13-1 31-2 8-7 22-9 42-7 0-7 

0-8 4-59 18-8 3-50 14-1 32-2 9-5 23-9 43-5 0-8 

0-9 5-06 | 197 | 4:34 | 152 | 33-0 | 105 24-9 | 443 | 0-9 
| 10 | 105 | 670 | 206 | 545 | 162 | 33-7 | 11-6 26-0 | 450 | 1-0 
bi 

f=3 faa. fas 
Zz x 
10 50 9 | 10 50 90 10 50 90 





0-0 11-6 26-0 45-0 18-8 35-5 55-2 26-7 45-2 64-6 0-0 

0-1 12-0 26-9 46-4 19-2 36-5 56°5 27:3 46-2 65-8 0-1 

0-2 12-4 27°8 47-7 19-8 37-4 57-7 27°9 47-1 67-0 0-2 

0-3 12-9 28-7 49-0 20-4 38-4 58-9 28-5 48-1 68-1 0-3 

0-4 13-5 29-7 50-1 21-1 39-3 59-9 29-3 49-0 69-0 0-4 
0 


0-5 14-1 30-6 51-2 21-8 40-3 60-9 30-1 50-0 69-9 
0-6 14-8 31-6 52-2 22-6 41:3 61-8 31-0 51-0 70-7 0-6 
0-7 15-7 32-5 53-1 23°5 42-2 62-6 31-9 51-9 71+5 0-7 
0:8 16-6 33°5 53-9 24-4 43-2 63-4 33-0 52-9 72-1 0-8 
0-9 17-6 34:5 54-6 25°5 44:2 64-0 34-2 53-8 72-6 0-9 





1-0 18-8 35-5 55-2 26-7 45-2 64-6 35-4 54-8 73-3 1-0 






































Notes. (a) The last digit is not guaranteed as correct. 
(b) If f>5, enter with 10—/ and find limits of 1—7. 


3-2. Single estimate of 7. When quoting a pair of fiducial limits, it is usual at the same time 
to give also a single estimate of the parameter. We suggest that the most appropriate single 
estimate in this case is the 50 % fiducial limit, ie. the median of the fiducial distribution of 
the parameter. It may be remarked that the fiducial median is unbiased in a more absolute 
sense than are those estimates which it is common to call unbiased. For example, any estimate 
of the variance of a Normal distribution is implicitly an estimate of the standard deviation, 
but if we say that an estimate is unbiased when its expected value is equal to the parameter, 
we make it impossible to find any estimate which, on undergoing the appropriate trans- 
formation, is at one and the same time unbiased both for the variance and the standard 
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deviation. In short, the definition of unbiased is purely relative to the form in which we chance 
to express the parameter. On the other hand, if by ‘unbiased’ we mean that the estimate is 
equally likely to be above or below the parameter, then the estimate so defined will remain 
unbiased under any transformation of the parameter. 

In the example considered above, we therefore take as our single estimate of 7 the value 
found for f = 3, « = 0-34 in the 50 % column 

m = 29-1 %. 
Our conclusions about the value of the parameter may therefore be summarized dia- 
gramatically as 
10 | 


40 10 = P(%) 


ie 
= 1(% 











13-1 29-1 49-4 
It will be observed that it is impossible to find a median on the basis of the simpler tabulation, 
since any choice between the two relevant fiducial distributions would be entirely arbitrary. 

3-3. Approximate solutions. As the great labour of tabulation of the exact solution hardly 
appears to be justified by the practical importance of the problem, one may inquire whether 
any rapid approximate solution is possible. One suggestion is that we might treat the relation 
between 7 and z as linear. This means that for a lower limit we find from the present tables 
the limits corresponding to f and f+-1, and take a random linear interpolate between them, 


whe) ang f)+ (1-2) mo(f+ 1), 
where x is a number chosen at random between 0 and 1. Similarly, for an upper limit, we 
find the limits corresponding to f—1 and f, and use 
an,(f—1)+(1—2x)m,(f), 
where z is the same x as was used for the lower limit. 

If we do this, we shall find that the true probability that 7 will be below the lower limit 
(or above the upper limit) is ‘always’ greater than nominal. This is unfortunate because it 
implies that we tend to overvalue our confidence that the parameter lies between the cal- 
culated limits. On the other hand, the variations in the true probability are much less than 
when the usual method is followed. The maximum amount of error in the probability is 
more a function of f than of n. If we make it a rule only to apply this random interpolate 
method when f>3 and n> 20 (otherwise using the usual method) then the maximum true 
probabilities that 7 will lie outside the calculated limits are: 





Lower limits Upper limits 
Nominal 2-5 10 10 2-5 } 0 
Maximum true 3-1 11-2 10-8 2-8 i: 


Usually, of course, the true probability will lie appreciably below its maximum, and the 
maxima themselves could be further reduced by raising f. The method seems then to be a 
reasonable one. It is also possible with the aid of a supplementary table to improve this 
approximation and make the maxima equal to the nominal! probabilities, thus putting 
ourselves once more ‘on the safe side’, but we are not convinced that even this supplemen- 
tary table is worth the trouble of computing. 

3-4. Example. Given f = 8 and n = 32, to find the 2-5 % fiducial limits. 

Entering our table in Fisher & Yates with f (=a) = 8 and p = 0-25, we find nm, = 3-67. 
Entering with f = 9 and p = 0-28, we find nz, = 4-40. Taking a random number 759..., we 
therefore have nt, = (0-76) (3-67) + (0-24) (4-40) 

= 3-85. 
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Hence T,) = 0-120. 
Similarly, the upper 2-5 % fiducial limit is found to be 
nm, = (0-76) (12-78) + (0-24) (14-64) 
= 13-23. 
Hence m7, = 0-413. 


4. Discussion 


4-1. The correction for continuity. Since tests of significance and methods of estimation 
are two poles of the same problem, it is to be anticipated that the idea of introducing a random 
increment will also be relevant to tests of significance, when the data are discontinuous. That 
the fiducial or confidence intervals, as usually calculated, are unnecessarily wide would 
imply that the usual tests of significance are more stringent than they appear. An examina- 
tion of a typical problem, such as the test of independence of a 2 x 2 table, confirms this. 
If f, the entry in the first cell, is above expectation, then we calculate G(f), the probability 
(on the hypothesis of independence) of obtaining the actual result or any larger value of f. 

It is dangerous to be dogmatic about what the average research worker does next. One 
might say that he draws his conclusion solely on an inspection and appraisal of the value of 
G(f). We suggest, however, that what ue usually does is to compare G(f) with some suitable 
level of probability, such as P = 24 %, and to say that the table shows significant departure 
from independence if 

G(f) <P. 
It is, of course, obvious that 
Prob {G(f)<P}<P, (4-11) 


and is in fact often much less than P. Hence if the nul-hypothesis is true, the probability 
of declaring the result significant at the 24 % level is less, perhaps considerably less, than 
24%, or in other words the test is more stringent than it appears. One may ask whether 
this matters very much. But the whole idea of ‘level of significance’ is based on the principle 
of running an accurately known risk of declaring the hypothesis false when it is in fact true. 
With continuous data, the declared level of significance is an exact measure of this risk. 
It seems to us to be of some, though perhaps not of great, importance that the same should 
be made true when the data are discontinuous, in order that the measure of the research 
worker’s confidence that he has overthrown the nul-hypothesis should have the same meaning 
in all problems. 
This can be assured if we measure P by the formula 


P = Q(f+1)+a9(f), (412) 


where x is chosen at random between 0 and 1, and P is compared with the desired level of 
significance. This means that instead of always counting in the probability of the actual 
result, we include only a random portion of this probability. 


When numbers are large, we note that this is approximately equivalent to adding to fa 


number z chosen at random between — }and + }, afterwards calculating x? in the usual way. 
This may be contrasted with the usually recommended correction for continuity, which 
consists in always subtracting } from f. 

The continuity correction here proposed may lead to a slight overvaluation of the signi- 
ficance of the table, instead of a considerable undervaluation (assuming of course that the 
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P obtained is compared with a standard significance level): The approximation might be 
improved by using the exact sampling variance of a cell entry after correction, thus writing 
x? as <4 (ad — be + nx)? (n — 1) 

0° (G40) (+d) (a+) O+d)} + fe%(n— ID’ 
where a, b, c, d are the four cell entries and z, as before, is drawn at random between — } 
and +4. 

It would, however, need a rather extensive investigation to discover how much the 
significance level thus calculated can diverge from the true probability of declaring a table 
significant. 

4:2. Conclusion. We suppose that most people will find repugnant the idea of adding yet 
another random element to a result which is already subject to the errors of random sampling. 
But what one is really doing is to eliminate one uncertainty by introducing a new cne. The 
uncertainty which is eliminated is that of the true probability that the parameter lies within 
the calculated interval. It is because this uncertainty is eliminated that we no longer have 
to keep ‘on the safe side’, and can therefore reduce the width of the interval, i.e. increase the 
precision of our estimation. 

We confess, however, that we were less interested in this practical gain than in overcoming 
an embarrassing situation which one meets when teaching statistics. The interval estimates 
can be given a vivid meaning if one can say (with a demonstrated justification): ‘I am willing 
to bet £(1— PF, — P,) against £(,+ P,) that the true answer is between such and such limits.’ 
When the class reaches the binomial distribution, however, this had to be recast in the form: 
‘T am willing to bet at least £(1— PF, — PF) against £(P,+ PA) ...’, to which any intelligent pupil 
will reply: ‘Since you say at least, you imply that you are able to raise the odds. How much 
higher can you make them?’ It is really quite intolerable for the teacher then to have to 
reply, ‘I don’t know.’ It therefore seemed worth while to show how this dilemma can be 
avoided. 
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ADDENDUM 

That the author has to take a plane to Rio, every time he wishes to consult a back 
number of the Journal of the Royal Statistical Society, may be advanced as an excuse for 
his having overlooked a mention of the same method as is described here, in a discussion 
at the Royal Statistical Society (see F. J. Anscombe (1948), J. Roy. Statist. Soc., Series A, 
109, 181-211 and the discussion which followed his paper). It was there dismissed rather 
briefly as being unsatisfactory. This may be granted but since, for a reason indicated in 
the last paragraph above, some solution is necessary, it seems that this one deserves to be 
studied and to be used by teachers of Statistics until a better one can be found. 


[In addition to the present paper by W. L. Stevens and the following paper by 
K. D. Tocher, a paper on a related subject by Mark W. Eudey, entitled ‘On the treat- 
ment of discontinuous random variables’ has recently been printed as Technical Report 
No. 13, issued from the Statistical Laboratory, University of California, under a contract 
with the U.S. Office of Naval Research. Ep.] 
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EXTENSION OF THE NEYMAN-PEARSON THEORY OF TESTS TO 
DISCONTINUOUS VARIATES 


By K. D. TOCHER, B.Sc. 
Imperial College of Science and Technology 


INTRODUCTION 


Of late attention has been redirected to the testing of 2 x 2 tables by Barnard’s suggested 
new test (1945, 1947a). There has been a mild controversy on the correctness of this test as 
compared with the ‘exact’ test of Fisher (1935, 1946), with contributions by Fisher (1945) 
and Pearson (1947). 

Barnard classified the situations giving rise to a 2 x 2 table according as, in repetitions 
of the experiments in question, both, one or none of the sets of marginal tota!s remain fixed. 

The first case, typified by Fisher’s lady tea-taster experiment (1942), presents no diffi- 
culties. The test is based on the cumulative hypergeometric distribution, and in common 
with all discrete distributions gives rise to a finite set of possible significance levels corre- 
sponding to the saltuses of that distribution. 

The second case, the comparison of two Bernoullian trials, is a test of the composite hypo- 
thesis that the success rates of these trials have an equal but unspecified value. Fisher’s test 
consists of treating the marginal totals as fixed at those actually occurring. He adopts a 
similar procedure in the third case of testing for association of the two factors in a sample 
from a bivariate binomial population. 

In both these cases, as Barnard (1947a) shows, the region of the appropriate sample space 
obtained by this procedure is non-similar, and the probability of obtaining a point in the 
region varies with the common success rate (or the two independent rates in the third case). 
As a partial remedy to this difficulty, Barnard proposed that for regions used in testing com- 
posite hypotheses the least upper bound of the probability of first kind error (considered 
as a function of the unknown nuisance parameters) should be used as the size. In the Ber- 
noullian trial comparison he also suggested a modification of the test region to give less 
variability of that probability with the success rate, the ‘nuisance’ parameter of the com- 
posite hypothesis. 


A MODIFIED APPROACH 


The Neyman-Pearson theory of tests considers all tests of the same size and lays down 
objective standards for selecting the ‘best’ test. In testing composite hypotheses con- 
cerning the parameters of discrete distributions, regions of constant probability do not, in 
general, exist, and the theory may only be applied to a modified definition of size such as that 
proposed by Barnard. 

Barnard’s size for a test region of 2 x 2 tables over-estimates the first kind of error pro- 
bability and can be termed a ‘bounded’ size. Wald (1939) has suggested the introduction of 
weighting functions of the nuisance parameters to produce a weighted mean probability 
measure. This does not necessarily produce a bounded size and presents difficulties of 
choosing the necessary weights. 
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An alternative to modifying the definition of size in dealing with discrete distributions is 
te alter the method of selection of the test region. The method in common use of defining 
@ region is equivalent to attaching to each point of the sample space a number w, of value 1 
if the point lies inside the region, and 0 otherwise. The number w associated with any point 
can then be regarded as the probability that the point lies in the region. An obvious generali- 
zation is to introduce as a preliminary to the analysis a random process which allows the 
w’s to take all values in 0<w< 1. 

This additional random process can only be justified on the frequency concept of pro- 
bability, relating to the chance of wrong decisions in continued repetitions of experiments 
and their analysis. The process is simply defined by a random variable uniformly distributed 
in (0, 1), and its introduction can be regarded as extending the sample space by one dimen- 
sion; the continuity in that dimension is sufficient to allow the theory for continuous sample 
space to apply. 

This device has previously been used incidentally in particular contexts, but its implica- 
tions have not been explored. The following sections give a general analysis followed by its 
application to 2x 2 tables, Barnard’s flower-growing problem (19476), and the testing of 
equality of means in samples from Poisson distributions. 


GENERAL THEORY—SIMPLE HYPOTHESES 


We consider the case in which the possible events are the enumerable set E,, Z,, ... with 
a sample space consisting of the set of points P,, P,, ..., the probability attached to the ith 
point being p,(9), where @ is a collective symbol for the parameters of the distribution. 

We require to test the hypothesis H,, 0 = 0), against the alternative H,, 6 = 0, and to use 
a region of bounded size a. Of all such regions that of maximum probability under the 
hypothesis H, is required. 


P(9,) 
Put Pid") — A, (1) 
P,(9) , 
and suppose that the points can be ordered so that* 
Ay 2A_gzAzg... FA_Z ++ (2) 
and that if 
Ay =A, then p,(9) < P;41(9)- (3) 
If Ai = Air and p,(O) = Pi41(9%), then p,(9,) = p441(91)- 


In this case, the events HZ, and E,,, have the same probabilities under either hypothesis, and 
so substituting one for the other cannot influence any judgement about the two hypotheses. 
Assuming that it is desirable that the probabilities of such equivalent events should enter 
any test procedure symmetrically, this can be achieved by pooling such equivalent events 
as a composite event (H;v H;,,) with probabilities 2p,(0,) and 2p,(0,), respectively, under 
the two hypotheses. Larger groups of equivalent events can be dealt with similarly. With 
this convention the equality of (3) can never arise, and the points or events are completely 
ordered by (2) and (3). 


* It has been pointed out that there is not always a maximum A in an enumerable set of A’s. However, 
even if that is so in any given case, it will still be possible to order them in a sequence 
00 PAig PA_gay --- MAQMA RAs... BAG? «ose 
In what follows such an alteration would merely alter the lower limit of summation from 1 to — oo. 


9-2 
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Any set of probabilities w, (i = 1,2,3,...) define a test procedure Q(w,) which rejects 
H, in favour of H, with probability w; if the event #; materializes in the trial or experiment. 
We require to determine w, to satisfy the following conditions: 


O0<w,<1 (i =1,2,3,...), (4) 
Zio) Sa, (5) 
Xo; P(9,) = B, (6) 
i=1 
where « is the fixed size and f is maximized. 
Define s by 
8 s+1 
LD Pi(9o) <%< F p,(p), (7) 
i=1 i=1 
and consider the procedure Q(i);) with 0, given by 
6,=1 (i = 1,2,...,8), 
& 
- 6 
} a a Zz Pi 0) (8) 
oan Ps+1(9o) 
0, = 0 (i = 8+2,8+3,...). 
ao ‘i ‘ 
Let 2 OiPd) =p. (9) 
Then for any other procedure of fixed size « 
& 
8 a — 2 Pil) rs) 
—B = ¥(1—,) p,(6,) + = — 2 .(0,)— E 0:7). 
B-B = X (1-0) (01) ++ Sgr Povsls)—_ & vePalOr) 
Eliminating « with (5), using (1) and rearranging, we obtain 
8 2 
B-B> 3 (1-0) Ae Aaya) PUD) +E 04lAasa— Av) Pi(Oo)- (10) 
= t=8 


From (2) we deduce that every term on the right-hand side of (10) is non-negative and hence 
A> B. The equality only holds if 


(a) Sup4(0%) = a, 
(6) each term on the right-hand side of (10) vanishes, i.e. 
l-w,=0 (¢=1,2,...,8), A+ Asat 
o,=0 (¢=8+2,8+3,...), Ay #Agi1- 
Thus equally powerful procedures only differ from 0(6,) in the w’s allotted to events of 


likelihood ratio A,,,. Q(6;) really uses the random process only if the event E,,, materializes, 
while all other procedures of equal power will involve it on some event of greater probability 
under H). 

If H, is to be tested against a claes of alternatives H which give a common likelihood 


ratio ordering of the sample space, then Q(;) is a ‘best’ procedure, using that word in the 
Neyman-Pearson sense. 
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UNBIASED PROCEDURES 


In the classical theory, when best critical regions do not exist for the class of admissible 
alternative hypotheses, one method of procedure is to restrict the choice of test regions to 
those that are ‘unbiased’, in the sense that such regions have a greater probability measure 
under all the alternatives than under the hypothesis under test. Various restraints can be 
made to specify the ‘best’ region in the different situations that arise. 

Neyman & Pearson (1936) showed that the construction of all these regions followed a 
pattern and could be deduced from the following lemma: 

Suppose /), F,, ..., Fj, are a set of functions defined for all points of a continuous space Q, 
and w is any region of Q for which 


) Fdw =¢; (j=1,2,...,k), (A) 


where c; are a set of constants. Then the region which maximizes 


[ 


k 
is defined by F, >> U;F;, where the U; are chosen so that w satisfies (A) and F is another 
j=1 


function defined over the space 2. 

In extending the results to unbiased procedures, an analogous result for the discrete case 
can be used with advantage. Suppose F;(7) are a set of functions (j = 1, 2, ...,&) defined at 
the points i = 1,2,... and w; (i = 1, 2,...) are any set of probabilities for which 


Zhi) = ¢5, (11) 
where c; are a set of constants. 
We require to determine w, so that 
® = Yo, Fi(*) (12) 
i=1 


is maximized, where F,(i) is another function defined at the points ¢ = 1, 2,.... 
Choose any set J of k points i,,i,, ...,i, and solve the equations 


k 
F,(?) = TGF (vel), (13) 


for U,, Uz, ...,U;,. Let the solution be U,(I), U,(Z), ..., U,(1). 
Define S(JZ) as the set of those points ¢ for which 


k 
F,(*) > ZU) F;(2). (14) 
Let 0,,,0;,,;,) ---,@y, be the solution of the system of equations 
6,F(i)=¢- 5 Bi) (j= 1,2,...,h). (15) 
ier te S(D) : 


We assume that there is at least one set I which gives a set of w’s all restrained to the range 
(0, 1). We can now state the result of the lemma. 
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® is maximized by any set of w’s defined as 
o,=6, (iel), 
=1 (ieS(J)), 
=0 otherwise, (16) 


where J is any set which gives the solution of (15) as probabilities. 
Let S be the complement of S(J) (which will be written as S), and suppose the © arising 
from the w’s of (16) is &. Then if w, is any set satisfying (11), we have 
$-0 = YH, Ai) + DA) - Lo, Kili). 
ie I ieS i=1 
Use (13), (15) and then (11) to eliminate 6; and then c;: 


k k 
LO, Kili) = YO, DU,() Ki) = LU) D4; Fi(2) 
tel ieI j=1 j=1 iel 


k k 
= 5 U;,(1) (c, - 3 Fi] ~2 UD] 3 (o —1) Fi) + Eo. Fii)} 


ae ieS 
ii 2 aa} « : 
Hence $-0= 511 — 0) {Ri)—¥ U,(1) Fi) - Zu, Ri) Yj F(a}. (17) 
see j=1 ) ies j=1 


From (14), it follows that each term of the first sum on the right-hand side of (17) is non- 
negative, and that each term of the second sum is non-positive. Hence > and the 
equality only arises if 

(4) o=1 (t€8), 


(6) w=0 or Fili)= SU) Fi) (ied). 
j=1 


Thus an equally powerful procedure can only differ in the critical probabilities w; assigned 
to points which can be interchanged with those of set J without altering the constants 
U;(Z) or the set S. One procedure can be obtained from the other by a mere interchange of w’s. 
In the theory for a continuous variable, an unbiased region of type A for testing a hypo- 
thesis concerning the value of a single parameter 6 against two-sided alternatives has a power 
function giving the size « for the value 6 = 0, under test, with a loeal minimum, and the 
maximum possible curvature at that value. 
The analogous unbiased procedure would determine a set of w’s to satisfy the following 
conditions: 
Lo; P; (Fo) = a, 
Dw, p4(Oo) = 0 (18) 
and Lw;p;(9,) is a maximum. 
Here the dashes denote differentiation with respect to 0. We apply the lemma with k = 2: 


F(t) 1 Pi(9%), F(t) es Pi(9%); F(t) rt Pi(9o); 


Cc, = &, C, = 0. 


Choose two values of i, 1, and i,, to form the set J. Regarding (p, p’, p”) as homogeneous 
co-ordinates in a plane, we determine the line through (p,,, »;,, pj,) and (p;,, Pigs Pi,): 


P4(9o) = U, pO) + Uz p49). 
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S consists of the set of points above this line, and is thus given by the aggregate of i, giving 
a constant sign to ; } 
BRM MH 

Pi, Pi, Pi, |: (19) 
Pi, Pi, Pi, 

We check that the solution of the equations 


O;, Pi,(9) + 04, Pi,(9o) = a—> p,(9%), 
ieS 


A , A , , (20 
0;, Pi, (Go) + &;, D},(9o) = — Z Pil); 


are in the range (0, 1) and if not, we repeat the process with other i, and i, until this condition 
is satisfied. The best procedure is then defined by the w’s: 


W; = 1 (te 8), 
V;, = Wj, (21) 
wi, = O45 d 


w;=90 otherwise. 


As an illustration, we consider the unbiased type A procedure for testing that the success 
vate @ in a set of n binomial trials has a value 0), against the set of two-sided alternatives. 
In this case 


. 


pi(6) = ([;)8(1-O-* (i=1,2,...40) 
= 0 otherwise, 


ie 
PP) = gag PA) - 


ri -[ fie) eo tA. 


The determinant (19) in this case can easily be reduced to 








Pi(9%o) ipo)  i*p,(o) S38. ° 
Pi,(9) 41 D;,(9) 15 p;,(9) = p;(9p) Pi,(9) Pi,(9o) 1 i, ¥ 
Pi,(9o) t2Di,(9o) 13 i,(9o) | 1 i, 


On expansion, this leads to an expression 
Pi(9o) Pi,(Po) Pig Po) (ta — 41) {47 — (ig +41) 0+ (19 + tg ¢, + 2F)}, 


whose sign is determined by the quadratic. The roots of this are clearly 1, and i,, and so the 
set S consists of the points i<i,, i>i,. We now require to determine i, and i, so that the 
equations ie * 


Pi,(9) O;, . Pig(9o) Oi, a aa & Pile) = 2 Pi(9), (23) 


i= 


a 


4-1 ° n 
(i, ~ 8p) D;,(99) O;, + (tg — 9p) Pig(Po) O;, = — x te —18q) p;(9o) 2, (@ —N8o) p;(9q); (24) 


have solutions for @;,, ,, which lie in the range (0, 1). 
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In general, iis must be accomplished by trial and error, using, if necessary, the In- 
complete Beta Function tables to evaluate the partial sums on the right-hand side of (23) 
and (24). However, in the special case 0, = }, an explicit solution is possible. We have 

P(t) = Pp<(4)- 

If i, = n—i,, (23) and (24) reduce to 


4-1 
Pi,(4) {O;, + O,,} = a— 22 p(t) 


and Pi,(4) {O;, —9,,} = 0, 
1-1 
ta-¥ pA(d) 
i.e. O;, = Or. = peer P 


so that i, is now determined from the inequality 


ss is 
Spd) <ta< Epil). (25) 
Thus the unbiased procedure of type A is defined by 
w,>- | (¢ = 1,2,...,4, -1,n—4,+1,n—1,4+2,...,n), 
70, (i =4,,n—-%,), 
=0 (6 =i 41,1, +2,...,.n-i,-1), 
where #, is given by (25). 
We illustrate the asymmetrical case by n = 10, 0) = %, a = 0-05. Each term p,(%) contains 


a factor 3-!° which we will omit to avoid rounding up errors. The following table gives this 
quantity in column 2: 


4 P,=3-" x p,(#) =P, xP; 
0 1 1 0 
1 20 21 20 
2 180 201 380 
3 960 1161 3260 
4 3360 4521 16700 
5 8064 : : 
6 13440 
7 15360 : 
8 11520 17660 : 
q 5120 6144 56320 
10 1024 1024 10240 


The upper part of column 3 contains the cumulative sum of the terms of column 2 starting 
at i = 0, while the lower part contains the cumulative sum starting at i = 10. Column 4 
contains the similar sums of iP,. 


We add 20/3 x eqn. (23) to eqn. (24) and then multiply by the resulting equations by 31°: 


4-1 10 
P,,0,+ Pj, = 0-05 x 310 _ LR a Fs 


4-1 10 
t,P;,0, +igP;, We = 2p x 0-05 x 310 __ z iP, a >, iP. 
i=0 i= 
We need to determine i,, i, so that the right-hand side of these equations are positive, 
while replacing i,, i, by i,+1, i,+1 gives them negative. It is clear that i, = 9 or 10. If 
4, = 10 then i, = 4, since 0-05 x 31° = 2952-45, and the greatest entry in column 3 less than 
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this is for 1 = 3. If 1, = 9, then we still obtain i, = 4, since 2952-45— 1024 = 1728-45. 
Substituting these last values in the equations, we obtain 
3360, + 5120w, = 1728-45 — 1161 = 767-45, 
4 x 3360, + 9 x 5120w, = 6183-00. 
These give 5 x 33600, = 724-05, w, = 0-0431, 
5 x 5120w, = 3113-20, w, = 0-1216. 

Thus the test procedure consists in rejecting the hypothesis if (a) i = 0,1, 2,3, 10; (6) if 
i = 4 and a four-digit number selected from a table of random numbers is less than 0431; 
or (c) if ¢ = 10 and the random number is less than 1216. Otherwise, the hypothesis is 
accepted. 


The extension of the theory to the analogues of type A and type C regions are also straight- 
forward applications of the lemma. 


GENERAL THEORY—COMPOSITE HYPOTHESES 


If the hypothesis under test does not completely specify all the parameters in the distribution 
involved, the size of a region may vary with the unspecified parameters, and to avoid this 
difficulty Neyman & Pearson proposed to restrict the regions considered to those with size 
independent of these ‘nuisance’ parameters. 

They showed how in certain cases it was possible to corstruct such regions by dividing 
the sample space into strata, and including a part of each strata in the region. The same 
method is available in the analogue for a procedure to test a composite hypothesis concerning 
a discrete distribution. 

Let p?(@) be the probability of the ith possible event in the enumerable set 1, 2, 3, ..., 
where the nuisance parameter has the value 0. The superfix 0 denotes that other parameters 
involved are fixed at the values under test, in the hypothesis Hj, and will be omitted until 
the alternative hypothesis is introduced. Let 

(0) = ap BO = 5 flog 7.0}. (26) 

Suppose that for each value of 0 the points i = 1, 2,... are divided into sets with equal ¢ 
and that the p?(@) satisfy conditions so that this division is invariant under change of 0. 
Label the sets S,, S,,S;, ... in any order; then the conditional probability of falling at a point 
+ of the jth set is (0) 

mp6) = —P&) __. 
x 7,(9) 
t€S; 


We show that this is independent of 0. Denote the common value of ¢ for all points in 8; by 


(9): 
ae ent16) _ n9(0) {log nf) 


= #00] 90) - Pe = pnw 2) | 


= 7P,() is certainly absolutely convergent, “ o we assume it uniformly convergent, we can 
t€S; 





(27) 


differentiate inside the summation symbol and obtain 


bet (9) ee (9) dei 
= Hp10)| 4 73, (6)24(0)}| = 0. (28) 
eS; 
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This is true for all 6 and so 79) (0) is independent of 6. Now choose any w; so that 


oe =a (j=1,2,...), (29) 

€3y 

then 50,p,(0) = & ¥ o,p,(6)= ( > on)  ».(0) — (30) 
i=1 j=1ieS; j=1\ \ieS; ie S; 


This set of w’s determines a procedure for which the size is independent of the nuisance 
parameter 0. 


We now show that a sufficient condition for the invariance of the sets S, under change 
of @ is that 
09;(4) 


“59 = VG$) = 1,2,...), (31) 
where y is any indefinitely differentiable function. For suppose i and j are two points in 


the same set for 0 = 0), then 
$:(9) = ;(9o)- 


Moreover Pi(9) = W(Oo, $i) = W(o, $j) = 94(9o)- 
dy /00, Oy /0d, and all higher derivatives of y are functions of @ and ¢; only. Hence 








0g; 


Continuing in this manner, we see that 


OD (O5) _ O*G;(Bo) 
50F = —a0r (32) 


Comparing the Taylor expansions of ¢,(9) and ¢,(8) about 0 = 0, we see that ¢,(0) = ¢,(4) 
for all @ in the range of validity of this expansion. We can then extend the range by analytic 
continuation, if necessary, to cover all 0. 

This derivation of similar test procedures differs slightly from the usual one. This establishes 
the equality of the moments of ¢ in a similar region and the total sample space, and hence 
under certain restrictions that of the distribution of ¢ in these two spaces. This requires the 
relation (31) to be replaced by the more restrictive one 


a )  OW(O,, d; oyr(4, , " 
Bil 04) = “Eg 00 4 PU eb 0 (0,) = We ED 5 Ere LD 904) = ol O0) 





of: — 4+Bg, (A, B independent of sample). 


In practice, this additional restriction is unimportant, as most cases where (31) holds the 
linear form does so also. 

Assume that the conditions considered above hold, so that similar procedures exist; we 
require to determine the best similar procedure to test the composite hypothesis H, against 
a completely specified alternative H,. 

Denote the probability of the ith event under H, by p?(0,) (9, is the value of f specified 
by H,), and consider the likelihood ratio of H, to any constituent simple hypothesis of H, 


pPP(A) = P?(4;) (0) 
~"BPO) ~ mi 2,1) 


Within any set S,, A, is always proportional to a factor independent of 0, and so the likelihood 
ratio order within sets is invariant under change of 0. 
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Ordering within each set by descending likelihood ratio, relabel the points of the sample 
space so that the probability of the ith event in the set 8, under hypothesis H, is PRy(F1); 
while under H, it is p)(). Redefine 

P49) 





hay = sw? (33) 
0 TPH) 
ie. the suffix ¢ now refers to ordering within the set S;. Put 
= x z of P(A, (34) 
and consider the procedure defined by 
OP =1 (t = 1,2,...,8;), | 
a— > Tj 
ay im © (35) 
Os41 = a6 
1 9541,5 
oY = 0 (i = 8,4 2,8;+3,...), 
where 8; are given by 
8; sjt+1 t 
MOS e< Vy (j = 1,2,...). (36) 
= i= 


Then if w¥) defines any other similar procedure 


6-0 = -= {OP — wo} D(A, 
=> | & (OP — nie [ PAy(4) )|- (37) 


By a previous argument, each term in square brackets of (37) is non-negative, and so ®> @. 
The result may be extended to show that the same procedure is the best of all bounded 
procedures. A bounded procedure is defined by any set of w’s, say w'?”, such that 


Loe 'p)(0)<a for all 0. 


Comparing this procedure with any similar procedure defined by w, we obtain 
L{oY” — wP} p00) <0 for all 0. 


Assuming that @ can take a non-enumerable set of values, leading to a non-enumerable set 
of different distributions p,)(0), we may regard the p,,(9) as arbitrary positive multipliers. 
Hence, it follows that w” < w for all i, j, and that 


Lo’ my < DOP my = a. 
t 4 


Hence 6-0’ = >» ls (OP — wf”) APnag | zee, (| > 0, (38) 
iL i 


as the separate terms are all non-negative. 

This result is illustrated by the case of 2 x 2 tables in the next section. 

The extension of the theory to composite hypotheses with several degrees of freedom, 
and the testing of such hypotheses against a set of alternatives, can be achieved by methods 
similar to those used in the classical continuous theory. Consequently, this extension is not 
pursued in detail here. 
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EXAMPLES. 2x 2 TABLES 
(1) Comparison of two binomial trials 
Suppose one trial of m members has a successes and c failures, while a second trial has 


b successes and d failures. What is the best procedure for determining whether the success 
rates in the two trials are equal? 

The possible events can be characterized by the number of successes in the two trials, 
viz (a,b). 

If the success rates are p,(=p) and p,(=£p) the probability of the event (a, 6) is 








(a,b) = (*) (2) ota —pyyrp801 — pa) (39) 
{2)(6) nV tee 
, Pr pres), (40) 


(") 
r 
where N.= m+n, r=a+b,s=c+d=WN-r. 

On the hypothesis under test, i.e. p, = p, or § = 1, the probabilities reduce to 





Py(0,) = Mn(a)( 7 ) Pr —py, (41) 
(")(3)_()(-2) 
h (2) = - (42) 
where 7 a (") (") 
Put Ti, m(@) = 37m) (43) 


Note that in the example ¢ is a parameter which is specified in the two hypotheses, while p 
is the nuisance parameter. We have 


a a 
6 = Shee semen tehet! =p) 


_ r-Np 
~ p(l—p)’ 
Thus the points of equal ¢ have equal r, and this division of the points (a, b) into sets is 
invariant under change of p. 


It is easily shown that the conditional probability in the set of points a+6 = r is given by 
T,, m(@), while the likelihood ratio is 
So er)" (* ™ ee)” (; v al 
a,b) = (= 2)" = o( 8 >=). 
vs gh 1—p . 1—p £—Efp 
Thus within the set of points a + 6 = r the likelihood ratio ordering is that of a, increasing 
with a if £ <1, and decreasing with a if £>1. 
Thus there is a common best procedure for testing against all the alternatives p, < p.(& > 1). 
This is defined by w(a,b), where 
w(a,r—a) =] (a<@, m); 
(4, m: pe a, m) = {a = I, (4, m nae 1)}/7, m(4r, m)> (44) 


w(a,r—a) =0 (a>, m), 
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and @, ,, is defined by II, m(@y,m— 1) <a < TI, (Gm) (45) 
In this case the suffix m is unnecessary as m does not vary, but it is introduced here to avoid 
repetition in the sequel. Similarly, there is a common best procedure for the other class of 


one-sided alternatives <1. This is most easily obtained by interchanging success and 
failure, a with c and 6 with d, and applying the above procedure. 


(2) Double dichotonsy 
Suppose a sample of N is classified according to two characteristics, and the numbers in 
the four resulting classes are a, 6, c, d. What is the best procedure for determining whether 
the characteristics are independent ? 
The possible events can be characterized by the triad (a,r,m). If the probabilities asso- 
ciated with the four classes are 7,,, P12, Poi, Poe, and we define 


P=PutPr I=1-p, 


‘ : , §=Pu-Pp’, (46) 
P=PutPan Y =1-p, 
then we have Pu = pp'+t, Piz = gp’ —é, 
Pa = PY —£, Poo = 9q' +8. (47) 


The hypothesis of independence is = 0, and p, p’ are the ‘nuisance’ parameters. 
The probability of the event (a, r,m) can be written 


N! 
P(a,r,m) = aibicldi Pu PisPi Pie 


= Ty, m(@) ((*) pov-| (mn) ping’ 


«('-a) (-ae) (ae) lo ernocee) 





In particular when £ = 0, 





N N ‘ , é 
Pelasr.m) = tawla){() | {( pm’, 49) 
! 0 _r—-Np 0 _m—Np' 
We have 3p {18 P,) = oe jp’ 8 F,) = —— 


Thus we divide the points into sets of equal r and m, and the conditional probability in 
these sets is clearly 7, ,,(a). From (48) the likelihood ratio within each set of constant r 
and m is a monotone function of a, increasing when £ > 0 and decreasing when é < 0. Thus, 
a best common procedure for the one-sided alternatives <0 is given by the same system 
of w’s as in (44) and (45), m now being allowed to range over m = 0, 1, 2,..., N. 

Fisher’s problem of the lady tea-taster is also based on the hypergeometric distribution 
7, m(@), and so it follows that a common procedure shall be used in each of the three situations: 

(a) a discrimination test of ‘lady tea-taster’ type, 

(6) a comparative trial for a one-sided alternative, 

(c) a double dichotomy for a one-sided alternative. 


The formal procedure consists of the following steps: 


(a) Fix a value of a; 
(6) Perform the experiment and record the result (a,r,m); 
(c) Calculate II, ,,(a) and II, ,,,(a—1); 
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(d) Reject the hypothesis if IT, ,,(a) <a. Accept the hypothesis if II, ,,(a—1) >. 

(e) Otherwise, take a single sample at random from a distribution uniform over the 
interval (0,1). If this value be £, compare this with the calculated quantity 

e= ax — IT, m(@ — 1) 
I, m(@) vi IL, m(@ re, 1) : 

Reject the hypothesis if > £. Accept the hypothesis if @< £. 

The usual practical method is a little different; the significance level is not fixed beforehand, 
but its minimum value leading to the rejection of the hypothesis is calculated. This is clearly 

ETL, m(@) a (1 cf £) II, ma = 1) (50) 

found by linear interpolation between II, ,,(a) and II, ,,(a—1) with argument ¢. 

For numerical illustration, suppose N = 12 and we obtain the result a = 2,b = 5,m=7 
from our experiment. Then 


1s, (1) = 75, (0) +775, 0(1) = 7bq(1+ 35) = 0-04525, 
II, (2) = 7hg(1 + 35+ 210) = 0-31040. 
For a test on the 5 % level of significance 
ae 0-05—0-04525 — 0-00475 
~ 0-31040—0-04525 — 0-26515 


Then if the random number selected is 0-21934, the hypothesis is accepted. For this random 
number the critical size which just rejects the hypothesis is 


0-78066 x 0-04525 + 0-21934 x 0-31040 = 0-10341. 


It may be argued that this test is applied to the joint experiment of choosing a random 
number and performing the experiment proper. This cannot be denied, but, if the random 
number is chosen carefully from a reputable table of such numbers, then the part of the 
hypothesis concerning £ is true, and so the truth or falsity of the joint hypothesis implies that 
of the part concerning the real experiment. 

Any criticism of this test must be based on a consideration of its power function as com- 
pared with that of other tests. Intuitively, one feels that the introduction of the random 
variabie reduces the power of the test. One procedure of bounded size consists of ignoring 
the experimental results altogether, and rejecting if <a, but this has no power of dis- 
crimination at all. 

Now it is clear that we cannot in the general case obtain similar regions without the 
introduction of this random variable, and so we must use one of the alternative definitions 
of size to control errors of the first kind. If a bounded size is used, the arguments of the 
previous section show that no system of w’s and in particular no system corresponding to an 
ordinary region has a larger probability measure under any of the alternatives tested. In 
spite of the introduction of the random element the test is more powerful than any other. 

If the frequency interpretation of probability statements is accepted, the adoption of 
this procedure resolves the controversy mentiored in the introduction. The slight modifica- 
tion of the Fisher test derived here produces a better test than the more elaborate changes 
suggested by Barnard. 

For very large size tables, the numerical difficulties of this test can be avoided by noting 
that the effect of the introduction of the random variable becomes negligible, and so an 
ordinary ‘exact’ test can be applied. For the large sample sizes this can be replaced by the 
normal approximation discussed by Pearson. 





= 0-01791. 
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OTHER EXAMPLES 
Fisher’s flower problem 


Barnard has discussed (19476) the problem, first proposed by Fisher, of testing one value 
of the success rate p, in a binomial trial against another value p, from N trials in which some 
random process operates to prevent some results being observed. Suppose that the pro- 
bability of this occurring to the result of any trial is 0, independent of the success or failure 
of that or any other trial. Suppose further than this random process acts independently on 
each trial. 

The example Fisher used to illustrate this general situation concerned sowing flower 
seeds whose plants either have red or blue flowers. A set of N seeds are sown, but chance 
factors destroy some of the resulting plants before they flower. If it is asserted that red and 
blue flowers are equally likely, how can we best test this from the numbers of red and blue 
flowers actually obtained ? 

In the general case let A(a,n) denote the probability that events are observable with 
a successes. We can show that 


Pta,n) = |( Jorn a—aye| {(") pea —py. (51) 


In this expression 0 is the nuisance parameter, and it is easily seen that the points of eunstant 
¢ are those of constant n. The conditional probability within such a set is merely 


n 
7,(@) = (") p*(1—p)"*. (52) 
This is the ordinary binomial distribution of index n, and so the best procedure is defined 
by the set of w’s w(a,n) = 1 (a<@,), 
a—1 f 
W(G,,n) = {a >> n4(a)} [9(@y) (53) 
a=0 
w(a,n) = 0 (a>4@,), 
Gn—1 Gn 
where 71,(a)<a< > 77,(a). (54) 
a=0 a= 


This test is exactly the same as the modified test for a simple binomial, and so Barnard’s 
discussion on the actual cause of failure to classify, and the validity of assuming that this 
is a random effect, seems irrelevant if this test is applied. 


Tests on samples from two Poisson series 


Przyborowski & Wilenski (1940) considered the problem of testing whether the para- 
meters of two Poisson laws are equal from a sample of one taken from each. Following the 
Neyman-Pearson principles, they derived a test which failed to give similar regions due 
to the discontinuous nature of the Poisson distribution. Clearly the modified procedure 
suggested in this paper can be applied. We can generalize the test to the case when the 
Poisson parameters are supposed in any ratio. 

Suppose the number of successes in the two Poisson trials (parameters p,, p, = Ap,) are 
N,, N,. The probability of this event is . 


My one 
Pn n ) = Pi* P2* e—P1+P2) 
mS fee 


= N 1 \% fe N—m {(1 +A) p,}% Fou . 
=(s) (a) (i) wit (NW = 1 +13). (55) 
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109 
P op, 
easily seen to be constant in the set of points of constant N, and within this set the con- 


To test the composite hypothesis A = Ay, we eliminate the nuisance parameter /,. 


ditional probability is 





mn) = (nea) (rey) - 


Thus the best procedure is defined by the ‘binomial’ w’s of (53) and (54), with p = =. 
n= WN anda=n,. . 
SUMMARY 


The practical difficulties of testing composite hypotheses concerning discrete distributions 
can be overcome by modifying the nature of a test region and the introduction of an addi- 
tional random process. 

The general results corresponding to the classical Neyman-Pearson theory are deduced 
and applied to the problem of 2 x 2 tables. 

A slight modification of the Fisher ‘exact’ tests is shown to be the best possible for one- 
sided alternatives in all of the three cases distinguished by Barnard. 

The difficulties of interpretation arising in the analysis of binomial trials with missing 
observations, discussed by Barnard, are seen to disappear with the use of this modification. 

Finally, the modification is applied to the test of equality of means in two Poisson trials. 
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A SIMPLIFIED FORM OF SHEPPARD’S CORRECTION FORMULAE 
By H. 0. HARTLEY 


1. INTRODUCTION 

The scope of this paper is fourfold: 

(2) To simplify Sheppard’s formulae for the calculation of moments from a grouped 
distribution. 

(b) To derive a simple procedure to deal with lack of high contact of the distribution 
function. 

(c) To derive formulae for the computation of absolute and fractional moments. 

(d) To obtain gauges of accuracy in form of remainder terms. 


2. FORMULAE FOR VARIATE RANGE @<2<b; a,b FINITE, HIGH CONTACT OF f(x) AT a,b 


Let f(x) denote a distribution function with continuous derivatives up to order 2k—1, k>0, 
and let z 
py = | flayarde (r= 0, 15 3,4, @. (1) 


os 
Write P(x) = | f6 dé. (2) 


Throughout we shall be concerned with the relation of the moments (see equation (3) 
below) of a mathematical distribution f(x) and its grouped frequencies f; (see equation (4) 
below). We are not dealing with the problem of estimating , from an observed histogram nor, 
indeed, with estimating certain characteristics of f(x) (such as its ‘start’ at x =a or the 
nature of a singularity) with the help of histogram moments. Such problems of estimation 
are, we believe, quite distinct from the plain problem of moment-quadrature with which we 
are concerned. 

We confine ourselves to smooth f(x), although generalizations are possible. Then 


b 
M, =a +r) P(x) ada. (3) 
a 
Our purpose is to derive a formula for x, which involves only the grouped frequencies 


at+ith ma 
f={ f(x) dz = P(a+i—1h)—P(a+th) 


a+i--1h 
=P,,-P,; (¢=1,2,...,n), (4) 
where nh = b—a (n integer). 
We apply the Euler-Maclaurin formula to (3) and obtain 





Mb, = F+C+S8, 
where F= NSP at, 
C = ar S  Biph- (6) pt-(a)}, | (5 
oti n-1 
S= Tai | a” | = (2+ dt, 


and where 
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a, = a+ih, p? is the jth derivative of ra’! P(x), ¢o,(t) = By,(t)— By, and B,,(t), By, are the 
Bernoulli polynomial and number of order 2k. If all derivatives of P(x) up to order 2k—2 
vanish at x = a and x = b, and if we choose 2k > 2r, then the terminals (C) in (5) can be written 


as 
C= z Si lads WB, (7). (6) 
If, therefore, the remainder term at in (5) is neglected, the formula for », becomes simply 
n-1 f 
p,~he'S; Patt +WB,(F), (7) 
i=0 
n 
where P,= > f;. If we choose our scale such that a = 0, we simplify (7) to read 
j=itl 
-1 
by = hr'S, Pai? +WB,. (8) 
i=0 


Formula (8) shows that the moment 4, is given immediately by the (r — 1)th moment of the 
P, using left group end-points x; and with a correction term h’ B, which does not involve the 
other moments. We shall show in §3 that (7) can be transformed to Sheppard’s formulae. 
However, the form (7) is computationally more convenient, in particular if u, is required only 
(and not all u,;, i<1r). Note also that (7) provides a means for simultaneous correction for 
grouping and shift of origin, as the value of a is perfectly general. 


3. THE EQUIVALENCE WITH SHEPPARD’S FORMULAE IF 2k>r 
Let us transform the moment sum of (7). We have 


n—-1 a r—1 n-1 
rh > ie 2, Siss 


a BET 


i=0s=0\ & 


¥ EECA Baste Ba 


ae athe 1 +7)-w3,(5). (9) 


Using now this result in (7), we obtain 


pa WS far (2)(G+1+4) Bald 


l=0 u=0 
~ 5 (7)mB ae : (10) 
where the grouped moment 7/,, is defined by 
n—1 
By, = 2, Fins(at+ (1+ 4) h)*. 
Equation (10) is Wold’s (1934) form for Sheppard’s formulae. 


4. THE REMAINDER TERM 


Following Fort (1948, p. 53), the remainder term S in (5) can be transformed into a more 


convenient form, viz. a-i AiO.. 
S = h**+1(2k)!1 By, S p™ (a+i4h), (11) 
i=0 


Thr 
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2k 
where 0<@<1 and p™® (x) = r F(a P(z)). (12) 


Since B,,,(2k!)-! < 4(27)-**, this gives a gauge of accuracy in terms of the derivatives of the 
‘moment function’ rz*-! P(x) similar to those occurring in interpolation formulae. 
In so far as the sum roe 


1 saat 
d p® (a+t+6h) 
0 


a 
in (11) can be replaced by papa (a +t) dt, it vanishes provided 
pe (a) = pi (6) = 0 
Nothing, however, is gained by a second appeal to the Euler-Maclaurin formula, as the 
formulae thereby obtained are less convenient than those resulting from an increase of k in the 
original formula (5). 
5. ‘'HE CASE a->—00 AND/OR b->00 

The case of infinite variate range is best treated by first truncating the moment (1), choosing 
finite a and/or 6, such that the error of truncation in the moment is as small as required. The 
formulae for finite a and 6 can then be applied. Note that if — a is large, equation (5) will have 
large terms of opposite sign in F and C which cancel. The magnitude of the remainder term S 
can often be gauged independently of a and/or 6 as follows. From its form (11) we note that 


n—1 —= 
the sum |h > p®) (a+-i+6h) | will have an upper bound independent of a, 6 (and m), pro- 
i=0 
vided a condition of the form P® (x) xi = O(a-2) (13) 
(q>1,¢ = 1,2,...,2k; 7 = 0,1,...,r—1) is satisfied. 


6. LAcK OF HIGH CONTACT, @ AND b FINITE 
Lack of high contact may arise frequently at a terminal (a and/or b) which is finite, but is less 
frequent at a = —oo or b = + 00, although there are distributions, such as the ¢-distribution 
for low degrees of freedom, which have poor contact at a = —0o and/or b = +00. We confine 
ourselves here to finite a and b. 

The simplest procedure is to express the derivatives in the terminals C of (5) in terms of 
differences. Such expressions are easily obtained by differentiating Newton’s formula (see 
Milne Thomson, 1933, pp. 157-8) which leads to Gregory’s formula of integration (loc. cti 
p. 193). For the present purposes it is computationally most convenient to express the 
advancing differences in terms of ordinates. We thereby reach a formula of the type 

My aa W'S re P48, (14) 
i= 
where the c, are plain numerical coefficients (tabled below) depending on the order (k) to 
which the Gregory formula has been taken, and S’ is a modified remainder term given (see 
Milne Thomson, 1933, p. 192) by 
ow s-'S Bay Bre=2j—1 (1) 

i (2)! @k= 25-1)! 

and S is given by (11), viz. db c. 
S = h*+1 (2k)!-1 By, = pee (a+i+@h). 
i= 


QWh2m—1 yf2k—-2 (£) (15) 


Note that the remainder term is for an even last derivative p®. As noo, S has the con- 
vergence property discussed in §5, whilst the additional terms do not increase in number 
(as n->0o) and can be majorized by the maximum of p®*-»), A table of the c, is given below. 


10-2 
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Table of coefficients c, in formula (14) for u, arising from the application of Gregory’s formula 











Order k of expansion 
2 | 3 | | 4 
Last difference occurring in Gregory’s formula 
4 o 6” 5” div ov 
n—1 0 0-416 667 0-375 000 0-348 611 0-329 861 0-315 592 
n—2 1 1-083 333 1-166 667 1-245 833 1-320 833 1-392 179 
n—3 2 1 0-958 333 0-879 167 0-766 667 0-623 975 
n—4 3 1 1 1-026 389 1-101 389 1-244 081 
n—-5 4 1 1 1 0-981 250 0-909 904 
n—-6 5 1 1 1 1 1-014 269 
n—T7 6 1 1 1 1 1 


























Three decimals will normally suffice in use. 

A good check on the adequacy of neglecting the remainder term (15) is given by using 
two different columns of the above table and comparing the moments thereby obtained. 

The computational procedure is simple. From the given P;, form c;P, and hence the 
moments /, from (14), ignoring S’. 


7. ABSOLUTE AND FRACTIONAL MOMENTS 


The generalization to absolute moments is trivial if a>0 or b<0. If a<0<b, we split the 
range intoa <a <0and0<a<band apply the above formulae (5) to both ranges separately. 
Fractional moments 


b 
My -| f(x)x'dx [r>0 (not necessarily integral)] 


arise, for example, in variate transformations of the kind y = 2”. 

We should again distinguish two cases, 

a>Oorb<0 and a<0<b. 

(7-1) a>0orb<0,i.e. negative powers of x are finite fora <x <b. In this case the formulae 
for no contact (14) are immediately applicable. The formulae for contact (5) are applicable 
with the reservation that B,(a/h) must be replaced by 

2k-2 r {a r—8 
a,(t)(ay" 
2 : 8) \h 

(7-2) a<0<b, i.e. negative powers of x are infinite at x = 0. In this case we must assume 
r>1 and the [r+ 1]st* derivative will have a singularity at x = 0 so that the formulae can 
only be carried to an order in which the [7 — 1]st derivative occurs in the remainder term S. 
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* [r+ 1]=largest integer <r+1. 
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SOME THEOREMS IN LEAST SQUARES 
By R. L. PLACKETT, University of Liverpool 


INTRODUCTION 


1. We shall consider the modifications necessary to the method of least squares when 

(i) the rank of the matrix relating the expectations of the observations to the unknown 
parameters is less than the number of parameters; 

(ii) the estimates of parameters, their covariance matrix, and the sum of squares of 
residuals all require to be adjusted, with a minimum of fresh calculation, due to the appear- 
ance of additional observations. 

Problem (i) is discussed in an appendix to Yates & Hale (1939). It is supposed that fixed 
relations obtain between the unknown parameters; by substitution, the covariance matrix 
of their estimates is determined, and a numerical example given. Our approach is confined 
to putting these results on a formal basis. 

Problem (ii) does not appear to have received attention since Gauss (1821) gave the 
necessary formulae for one additional observation. Using a different method, we develop 
the formulae for several observations, indicate when these are likely to be of service, and 
illustrate the computational procedure. 

2. As regards notation, let 6(s x 1) be a vector of unknown parameters, x(n x 1) a vector 
of observations, and A(n x s) a matrix of known quantities. Then 

Ex = A@, 
where Ex is the vector of expected values of the observations. We suppose further that 
E(x — A®) (x - A®)’ = oJ, 
where o? is the unknown common variance o the observations. Here J, denotes the n x n 
unit matrix, so that the observations are uncorrelated. To suppose the observations have 
a covariance matrix V, known apart from a constant factor, introduces no further difficulty 
and will not be considered. 
Put C = A’A. The estimate 6* of 6 provided by the method of least squares is 
6* = C-1A’x 
in the usual circumstances when A has rank s so that C-! exists. The matrix of covariances 
of the elements of @* is then o?C-1, and the sum of squares of residuals 
M = (x— A6*)’ (x— A6*). 


With Q = (x— A6)’ (x— A®) 
and S = (0* — 6)’ C(6* —6), 


it is well known that Q=M+S8. 


METHOD OF LEAST SQUARES WHEN A HAS RANK LESS THAN 8 


3. Lemma. If A is of order n x s and rank s—t (¢ > 0), then 
(i) there exists D, order s x ¢ and rank t¢ such that AD = 0; 
(ii) D is unique apart from a factor U,, non singular ¢ x t. 
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Proof. (i) Let Ag be a critical minor of A and suppose, without loss of generality, that it 
consists of the first (s—t) rows and columns of A. Let A, consist of the same rows and last 
¢ columns. Put 


Evidently D is of rank ¢; and the first (s —t) rows of AD consist of zeroes. It is known, how- 
ever (Aitken, 1939), that every row of A is linearly dependent on the first (s —t) rows, so AD 
must consist «::tirely of zeroes. 


(ii) Suppose now d is a column vector such that 
Ad = 0. 
With the aid of the ¢ x 1 vector d,, consisting of the last t elements of the s x 1 vector d, form 
d, = d+ Dd,. 
The last ¢ elements of d, are zero. Let d, consist of the first (s —t) elements of d,. Then 
0=Ad,_ given 
= Ad,, by definition of d, 
= A,d,. 
Since A, is non-singular, dy = 0 and d, consists entirely of zeroes. Hence any other matrix 


D, satisfying AD, = 0 must have its columns linear combinations of the columns of D; and 
must hence be of the form D.=DU 
- te a? 


where U, is of order ¢ x t. As the rank of a product cannot exceed the rank of either factor, 
U, must be non-singular if D, also has rank ¢. 


4. Lemma. If (1) A and D satisfy the conditions of the lemma in § 3; 
(2) Bis of order ¢ x s and rank ¢ such that BD is non-singular; 
(3) U, is non-singular ¢ x ¢; then 
(i) (A’A+B’U,U,B)" exists; 

(ii) (A’A + B’'U;,U,B)-*A’ is independent of the choice of U;; 

(iii) (A’A + B’B)1 B’ = D(BD)-. 
Proof. (i) Consider 

0’(A’A + B'U,U,.B) 6 = (A®)’ (A®) + (U, BO)’ (U, B6). 
This is a sum of squares and so non-negative. The only vectors.@ making A® = 0 are columns 


of DU,, and the definition of B excludes a column of U,B DU, consisting entirely of zeroes. 
Consequently the quadratic form is positive definite and its matrix will possess an inverse. 


(ii) Put L = (A’A+B'U,U,B)" A’, 
giving (A’A + B’'U,U,B)L = A’. 
Premultiply by D’ and obtain BL =0, 
so also A'AL=A’. 


These + wo equations can be recombined to give 
‘ L=(A’A+B’B) A’, 


hence the invariance of Z under transformations like B > U,B. 
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(iii) (A’A + B’B)D = B’BD 
and so (A’A+B’B)?* B’ = D(BD). 

The right-hand side is invariant under transformations D> DU,. 

5. When the matrix A, relating the expectations of the observations ‘o the unknown 
parameters, has rank less than s, it becomes necessary to alter that approach to justifying 
the method of least squares which begins with estimates linear in the observations. This is 
because 6* = Kx, 
where K is s x n, cannot be an unbiased estimate of 6 for all 6. If it were, 

I, = KA, 
implying D= KAD =0, 
which is a contradiction. The situation can arise, for example, when the number of para- 


meters exceeds the number of observations; or when there are fixed relations holding between 
the parameters. Under these conditions, we must suppose that in addition to 


Hx = AB, 
there exists a set of constraints on the values of 8, expressed by 

y = Be, 
where y is a non-random known vector and B any matrix satisfying the conditions of the 
lemma in § 4. The choice of B is thus restricted by A in that if 

AD = 0, 
then BD must be non-singular. The linear unbiased estimate of minimum variance is now 

6* = (A’A+ B’B)"(A’x+B’y), 

obtained by applying the method of least squares to the observations 


: 


as if they were all uncorrelated random variables with equal variance and expectation 


‘h 


6. Further results are contained in the following Theorem. Given that 

(1) Ex = A®, where A is a known matrix of order n x s and rank s —¢; 

(2) H(x—A6) (x—A6)’ = o*I,, where o* is unknown; 

(3) y = BO, where y is a non-random known vector and B any matrix satisfying the 
conditions of the lemma in § 4; 

then (i) the linear unbiased estimate of 8 having minimum variance is 

6* = (A’A+ B’B)1(A’x+ By); 
(ii) the covariance matrix of 6*, 


L, = E(0*—6) (6* — 0)’ 
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is found by solving [,A'A = I,—D(BD)“ B, 


where D is defined by the lemma of § 3. 
Proof. (i) We note that the equations 


y = Be 
are equivalent to Usy = U, B6, 
where U, is an arbitrary non-singular matrix of order ¢ x t. Suppose 
6* = Ix+Ny 
is an estimate of 6. If unbiased, I, = LA+NB, 
giving D = NBD, 
or N = D(BD)“ 
= (C+ BB) B’. 


From the first of these equations for N, it is clear that Ny is invariant when y is replaced 
by U,y and B by U, B. Also 
LA = I,—(C+B’B)"B’B 


= (C+ B’B)"C. 
Because of this relation, the covariance matrix of 8* is 
LI’ = [((C+ BB)" A’) [(C + BB) A’}+[L—(C+ BB)" A) [L—(C+ BB) A’), 
£0 L=(C+B’B)'A’, 
also invariant if B is replaced by U, B, gives minimum variance. Thus the preferred estimate is 


6* = (C+ B’B)(A’x+B’y). 
(ii) The covariance matrix 


Ly = LL’ = (C+ B’B)10(C + B’B)". 


Therefore L,(C + B’B) = (C+ B’'B)"*C 
=I1,—NB 
= I,— D(BD)" B. 


Finally, remembering L’B’ = 0, 
L,C = I,—D(BD)“ B. 


Once again, the right-hand side is unaltered if D is replaced by DU, and B by U,B. 


ADJUSTMENTS DUE TO APPEARANCE OF ADDITIONAL OBSERVATIONS 


7. It may happen that an experiment is planned to be of a certain size, but fails to provide 
all the information expected, so that it becomes necessary to make more observations in 
order to increase precision and form a more definite opinion of the magnitudes of particular 
factors. Alternatively, the arithmetical processes necessary may be facilitated by supposing 
the observations to consist of one set x, from which 6* and YU are easily determined, together 
with some additional observations for whose effect simple adjustments can be made. Suppose 
that the original experiment consisted of n observations x with expectation A®@, where A 
is of order n x s and rank s, and that an additional m observations z with expectation F@ 
come to hand, F being of order m x s. 
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Denote the new vector of observations 








x 
4 
by Xp, and [4 
LF | 
by Ay. We assume that E(X9— Ao®) (Xp — Ag 9)’ = 7D, n- 
Put Cy = Ay Ao 
and the new estimate of 6, 0° = C5! Ag Xp. 
We also require R= FCF’ 
and R, = FC,'F’. 
8. We first discuss the alteration in the covariance matrix of the estimates. It is evident 
that — I,+R 


is positive definite and therefore possesses an inverse. Now 
RR, = FCF’ FCoF' 
= FC-(C,—C) Cp iF’ 


= R—R,. 
Thus (Ln +R) (Ln—- Bo) = Ins 
giving (Ln — Ro) = (L, +R). 
Further, (1, +R) FC = FC — FC pF’ FC 
= FC-1— FC>51(C,-—C) Cc 
= FCF}. 
Consequently CAF(L,+ BR) FC = C-1F’FC>! 


= C-1_—C>l. 
This is a convenient formula whereby the change in the covariance matrix of the estimates 
can be determined with a minimum of fresh calculation, provided m is small and less than s. 
We assume that C-! is known already. Since (J,,+ R)- is positive definite, it is clear that 


each element of 6° has a smaller variance than the corresponding element of 6*, as we would 
naturally expect. 


9. Next, the difference between 6° and 6* has to be considered. Since 
AjXo = A’x+ F'2z, 
F’(z— F@°) = Ajx,—A’x—(C,—C) 6° 
= C(6°—6*). 
Premultiplying both sides by FC-", 
R(z— F9°) = F(0°— 6*), 

or (z— F@*) = (I,,+ R) (z— F@°). 
Hence (8°—6*) = C-1F’(I,, + R)-1 (z— F6*). 


This expression gives the difference between the two estimates in terms of the old estimate 
and the new observations. 
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10. Finally, if M, is the new sum of squares of residuals, f 
M, = (x— A®°)’ (x — A®°) + (z— FO)’ (z— F0°). : 
Remembering that Q=M+S8 


for all values of 6, we have 
(x — A@°)’ (x — 46°) = M + (0°—6*)’ C(6°— 6*) 
= M+(z-—F6*)’ (Z,,+ R)" RU, + RF) (z— F6*). 
Also (z— F6°)’ (z— F@°) = (z— F6*)' (1, + RF) (L,, + RB) (z— FO*). ] 
Combining all results, 5 
M, = M +(z—Fe*)’ (1,,+ RF) (z— F6*), 


giving in terms of the old estimate and the new observations the amount by which the sum 
of squares of residuals is increased. 

11. By redefining x and z, we can adapt the foregoing analysis to solve the problem of 
missing observations, investigated by Yates (1933). Let x now denote the observations 
which appeared, with expectation A; and let F@ be the expectation of those measurements 
we were prevented from making. When C>! is easily calculated but C- is not, the relation 


C1 = Col+ColF’(L,— Ry) 1 FCS 
may be useful. If 6* is the estimate from the available observations, introduce fictitious 
observations z* — Fe*. 


_— — = = ee oe 


The estimate 6° from both real and fictitious observations will equal 6*. Therefore 


z* = F@° 
= FC5\(A'x+ F’z*), 
or (1, — Ry) z* = FCG'A’x, 
a set of equations from which z* can be calculated, and then 6°. We see also that 
M, = M. 


This brief review of a standard technique has been introduced to prepare the ground for the 
computational procedures in the next section, which have points of similarity with the 
foregoing. 

12. An experiment planned in the form of five rows and six columns gives the following 
thirty-six observations: 











1 2 3 4 5 6 Totals 
1 7-60 10-99 10-86 | 10-17, 9-63 10-12 7-06 56-80, 66-43 
2 11-06 11-56, 9-92 | 10-68 | 10-58 10-15 | 6-91 60-94, 70-86 
3 8-25 1]-48 11-81 | 10-37, 11-36, 10-40 8-99 7°37 58-27, 80-03 
4 10:37, 9-81 8-41 11-38 | 10-95 9-24] 7-21 57-56, 67-37 
5 9-43 11-12 11-77 | 11-81 7-71 6-98, 8-59] 58-82, 67-41 
Totals | 46-71, 56°52 | 53-56, 63-48 | 56-50 | 53-88, 85-27 46-21 | 35-53, 44-12 | 292-39 
































We shall suppose this experiment to consist of six additional observations (in heavy type) 
superimposed on the remaining thirty, which form a standard pattern. The marginal totals 
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for both thirty and thirty-six observations are given, the latter being given in heavy type. 
As usual, the expectations of the observations are taken to be of the 


w+a;+b,, 


where a; is the contribution from the ith row, 6; from the jth column, and 


Ya; = x4; = 0. 
t j 
Put u = z— F®@*, 
so that (1,+R)u = z— F@*. 


It is essential to note that the rows of F consist of repetitions of the rows of A in this par- 
ticular example. Therefore F'6* is the estimate from thirty observations for cells containing 
more than one observation, and has, for example, two elements which equal the predicted 
value for the cell containing two additional observations. Further, Ru is the contribution 
this estimate would receive from numbers u sited where the observations are given in 
heavy type. We make the association thus: 


9°63, U,; 9°92, we; 11-36, uz; 10°40, us; 9°81, uw5; 8-59, ae. 


The contribution from the cell with two additional observations is then calculated as if this 
cell contained w+ v4. 


Using these results, the equations satisfied by u, uo, ...,U, are: 

Uy + §Uy + $(Uy + Ug + Wy) — Fo (Uy + Ug + Ug + Uy + Us + Ug) 

= 9-63 — 4(56-80) — (53-88) + 2y(292-39), 
Ug + $Ulg + hig — gg (Uy + Ug + Uy + Uy + Us + Uy) 

= 9-92 — }(60-94) — }(53-56) + 2,(292-39), 
Ug + (Ug + Wy) + (tly + Ug + Uy) — gig(Uy + Uy + Ug + Uy + Uy + Ug) 

= 11-36 — }(58-27) — (53-88) + 2,(292-39), 
Uy + F(Ug + Uy) + (Uy + Ug + Uy) — gg (Uy + Uy + Ug + Uy + Us + Ug) 

= 10-40 — 4(58-27) — $(53-88) + 3,(292-39), 
Us + $Us + bus — gig (Uy + Ug t+ Uy + Uy + Us + Us) 

= 9-81—4(57-56) — }(46-71) + 2,(292-39), 
Ug + ig + bg — Fg (Uy + Ue + Ug + Ug + Us + Ug) 


= 8-59—}(58-82) — (35-53) + 2,(292-39). 
On rearrangement, they become: 


40uU,;— Usgt 5ug+ 5uz— Us— Ug = — 25-99, 
— U,+40U,— Us— UW— Us— Us = — 36-07, 
5uj— Ug + 40u3+10u,— uz— ug=+18-56, 
5u,;— Up +10u,+40u,— Us— u, = —10°24, 

— UW— Ug— Uzs— Uyt+40u,— Uu, = + 18-63, 
— UW— Usg— Us— U— Us+40u, = + 42°81. 
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A solution is found by iteration, with zero as a first approximation. It is 
Uy Us Ug U4 Us Ug 
—0-6746 —0-8726 +0-6435 -—0-3165 +90-4615 +1-0513 
13. Having determined u, we are in a position where the analysis can be rapidly completed. 
Since 6° = C-1(A’x+ F’u), 
the estimates of row and column effects are those obtained from thirty adjusted observations, 


the adjustment being made by adding to each of the original observations all the corre- 
sponding elements of u. Thus, 10-37 becomes 


10-37 + 0-6435 — 0-3165 = 10-70. 
The table of adjusted observations, with their marginal totals, is: 














1 2 3 4 5 6 Totals 

1 7-60 10-99 10-86 9-50 10-12 7-06 56-13 

2 11-06 10-69 10-68 10-58 10-15 6-91 60-07 

3 8-25 11-48 11-81 10-70 8-99 7-37 58-60 

4 10-83 8-41 11-38 10-95 9-24 7-21 58-02 

5 9-43 11-12 11-77 11-81 7-71 8-03 59-87 
Totals 47°17 52-69 56-50 53-54 46-21 36-58 292-69 
































For example, the estimate of w is (292-69)/30 = 9-756 and not (352-10)/36 = 9-781. 
From the thirty original observations, we calculate 


M = 20-3264. 
The increment due to the additional six is 
(z— F6*)’ u = 2,[(25-99) (0-6746) + ... + (42-81) (1-0513)] 


= 3-9265. 
Thus My = 24-2529. 
With 6 = 0, Q = 3529-0596, 
the sum of squares of all thirty-six original observations, and hence 
S = 3504-8067. 


To determine the sum of squares for rows, remove from S the amount due to separate column 
effects, namely, 

4 (56-52)? + (63-48)? + (56-50)? + 2(85-27)? + (46-21)? + 3(44-12)?, 
and obtain 3504-8067 — 3502-8603 = 1-9464. Similarly, the sum of squares for columns is 
58-9338. 











Variation Sums of squares D.F. Mean squares F 
Rows 1-9464 4 0-4866 0-52 
Columns 58-9338 5 11-7868 12-64 
Residual 24-2529 26 0-9328 — 
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14. Because of the systematic nature of [,,+ R, its inverse is found without difficulty. 
In fact, 


-0-025674 0-000542 —0-002535 —0-002535 0-000542 0-0005427 
0-025071 0-000474 0-000474 0-000681 0-000681 
A(I, +R) = 0-026949 —0-006385 0-000474 0-000474 
0-026949 0-000474 0-000474 
0-025071 0-000681 
. 0-02507 14 








Each diagonal element of O-1F'(L, +R) FO! 


is a quadratic form in the elements of the corresponding row of C-1F’, and these elements 
are coefficients in the estimate from thirty observations. For the mean w, the row is 


gil, 1, 1, 1, 1, 0, 
and the quadratic form has value 0-004830. Therefore the variance of the estimate of w, 
apart from a factor o?, is 
0-033333 — 0-004830 = 0-02850, 
as compared with gs = 0-02857. 
Roughly speaking, the departure from orthogonality is equivalent to the loss of one 
observation. 
Again, the difference between the mean of column 4 and the grand mean is estimated as 
10-708 — 9-756 = 0-952. 
Here, the corresponding row is 
[$—g0, —30 $—go $—so> — 30> — go), 
or Af8) ~ 1,6, :6, — 1, —2}, 
and the quadratic form has value 0-04837. The multiplier for the appropriate variance is 
0-16667 — 0-04837 = 0-11830. 
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WEIGHTED PROBITS AND THEIR USE 
By A. N. BLACK, Donald Pollock Reader in Engineering Science, University of Oxford 


When test specimens, subjected to a treatment or ‘dose’, can only give an all-or-nothing 
response, for instance, ‘death’ or ‘survival’, the method of probit analysis is often used to 
obtain a quantitative estimate of the effects of varying intensities of dose. Groups of speci- 
mens are treated with measured doses, the proportions surviving each dose are converted to 
probits, and the regression line connecting probit, y, with dose, x, is estimated. Since the 
probits must be weighted and converted to working probits and a process of successive 
approximation is needed, the computations can be rather long; the table which follows is 
designed to shorten them. For a general description of the method the literature should be 
consulted (Finney, 1947). The essential feature of the table is that the weight and weighted 
probit of a test group are obtained by at most two multiplications by simple integers of 
quantities read at a single entry of a single compact table. 
The quantities tabulated, with argument the expected probit, Y, are: 


; Y-5 ] 
(i) the expectation, P = he Jen) 
(2) the weight, w = Z?/(PQ), where 
1 
~ (2m) 
(3) the weighted minimum probit 
wy, = w(Y —P/Z), 
(4) the weighted maximum probit 
wy, = w(Y+Q/Z). 


The last two quantities are conveniently thought of as the scores associated with an indi- 
vidual test according as the outcome is survival or death. For expected probits above 6-42 
the minimum score is negative; in this region the tabv_:. -d figure is the weighted minimum 
probit increased by 100, since it is convenient in this cass ‘0 set negative numbers on a calcu- 
lating machine as their complements. The tabular interval of 0-02 in Y is sufficiently close for 
most purposes, and interpolation to 0-01 in special cases can be done mentally. 

To calculate the probit regression line there are needed S(nw), S(nwa), S(nwy), S(nwz*), 
S(nwxy). Using the tables of Fisher & Yates (1943) the method of obtaining nw and nwy is: 


et? du, 





etr-5", Q=1-P, 


(1) extract w from the table, 
(2) multiply by n to form nw, 
(3) extract (Y +Q/Z) and 1/Z from the table, 
(4) form y = Y +Q/Z—q/Z, where q is the proportion of survivors, 
(5) multiply y by nw. 
With the tables of Finney (1947), for steps (3) and (4) above substitute: 


extract y from a second table. 
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With the present table the process is 


(1) extract w and wy, from the table, 

(2) multiply by s, 

(3) extract wy,, from the same line in the same table, 
(4) multiply by d, 


where s and d = n—s are respectively the number of survivors and deaths. 

Clearly the present method is quicker than that of Fisher & Yates. One advantage over 
Finney’s method is that all quantities are taken from a single compact table of single entry, 
arranged so that one works steadily through the table. Finney’s method uses two tables, of 
which one is double-entry, requiring more page turning; the intervals of tabulation are 
scarcely fine enough with large groups or large numbers of small groups, which will occasion- 
ally produce working probits differing widely from the expected probits. The present method 
also lends itself to a great reduction in the work of summation when the values of x are 
equally spaced. Thus this method shows to best advantage when z is equally spaced, there 
are a number of groups with no deaths, or no survivors, there are large numbers of observa- 
tions, or there are very few individuals in any one group, as may easily happen in multi- 
variate work. In multivariate work it may be convenient to use one card for each observation 
and record the weight and score direct from the table; where the number of observations and 
variables is sufficient to justify it, this technique is well suited to a punched-card tabulator. 

The exact lay-out of the computation depends on the type of machine used, and individual 
computers will develop their own methods. Nevertheless, a description of methods which 
have been found convenient with this table may be useful. Although somewhat complicated 
machine techniques are described which minimize copying and resetting, the tables can of 
course be used as described below to obtain nw and nwy, which are then written down and the 
sums and sums of products formed successively in the usual way. Abbreviations used are: 
SL for setting levers or keys, MR for multiplier register, and PR for product register. For 
much of the work two functions are developed simultaneously on the machine, one on the 
left- and the other on the right-hand side. In such cases the two sides of SL and PR are 
distinguished by the letters L and R. The methods to be described are appropriate to a hand- 
calculating machine of reasonably large capacity; they were in fact performed on a machine 
of capacity 9x 8x 16. Different methods are used according as the values of z are equally 
spaced or not, but the preliminary stages are the same in either case. A general description of 
each method is given and followed by a detailed description illustrated by a worked example, 
with schedules showing the work-sheet as it would actually appear, and also a progressive 
record of the machine operations. In order that the methods may be more easily compared 
the same example is treated by each method. It will be found that the calculations are much 
shorter when the values of x are equally spaced, and this fact should be borne in mind when 
planning experiments. 


PRELIMINARY STAGES 


Expected probits are found from the observed frequencies and the tabulated values of P in 
the usual way. Values of nw and nwy are then developed simultaneously on the left- and right- 
hand side of the machine. Schedules 1 and 3 show the work-sheets, and 2 and 4 the detailed 
machine operations; the lines on these sheets are lettered and numbered for easy reference. 
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The proportions of deaths, P, are 14/15 = 0-933 at 2 = 3, 9/16 = 0-561 at 2 = 2 and 
4/14 = 0-286 at x = 1. From these values of P the corresponding probits (= 6-5, 5-2, 4-4) are 
found from the table. A straight line roughly passing through these points is that for which 
Y = 6-5, 5-4, 4-3, 3-2 at x = 3, 2, 1, 0, and these values are entered in §§ A-D of Schedules 
1 and 3. Corresponding to the first Y (= 6-5) the values of w (= 0-269) and wy, (= 99-810) 
are obtained from the table. We shall use 3 decimals in w but only 2 in wy. Since the value of 
wy is a complement, the value of w (= 0-269) must in setting be reduced by one unit of the last 
decimal used and followed by a succession of 9’s; so 268/999981 is set on SL ($1). The / 
indicates the division between the two sides of the machine. This setting is now multiplied 
by the first value of s (= 1) ($1). Leaving w set on LSL, change RSL to wy,, (= 1-89), also 
taken from the table with argument Y = 6-5, so that the new setting is 269/000189, and this 
is multiplied by the first value of d (= 14) (§2). LPR and RPR now show the first values of 
nw (= 4-035) and nwy (= 26-27) respectively (§ 2). These values are written down (§ A). 


UNEQUAL INTERVALS OF x (Schedules 1 and 2) 


The methods appropriate to equal and unequal intervals of x now diverge; we describe first 
that for unequal intervals, shown on Schedules 1 and 2. After the values of nw and nwy have 
been written (§ A), the machine is cleared. The values of nw and nwy corresponding to the 
remaining values of Y are next formed and written down in exactly the same manner 
(§§ 3-7, B—D). Next the values of S(nwa*), S(nwa) and S(nw) are formed simultaneously in 
LPR, RPR and MR. S(nw) is divided into S(nwz) to form %, while A = S(nwz?) —% . S(nwz) 
is formed simultaneously in LPR. Then S(nwaxy) and S(nwy) are formed in LPR and RPR. 
S(nw) is divided into S(nwy) to yield 7, and B = S(nwxy)—Y.S(nwz) is simultaneously 
formed in LPR. The latter is then divided by A to give b. The values of Z, 7 and b are now used 
to develop new estimates of Y, and the solution is repeated with these values as a check. 
Owing to the small interval of tabulation, the values of Y used in the check calculation will 
mostly be different, so that the chance of repeating a mistake is small. 

The details of this process can be followed in Schedules 1 and 2. After getting nw and nwy as 
previously described, set x? and x on LSL and RSL for the first 2 (= 3), and multiply by the 
corresponding value of nw (= 4-04) ($8). Without clearing any register, set each x? and x in 
turn and multiply by the corresponding nw (§§ 9-11). This yields S(nmw) (= 23-27) in MR, 
S(nwz2) (= 38-81) in RPR and S(nwa2?) (= 82-29) in LPR; the first two are written down and 
MR is cleared (§ 11). Next S(nwa) (= 38-81) and S(nw) (= 23-27) are set on LSL and RSL, 
and the latter is divided into S(nwa) which is still in RPR. This produces % (= 1-6678) in MR 
and A = S(nwa?)—%.S(nwx) (= 17-56) in LPR (§12, F). After clearing the machine, each 
value of x is set in turn into LSL, with 1 set on RSL, and multiplied by the corresponding 
value of nwy (§§ 13-16); this yields S(nmwxy) (= 210-7) in LPR and S(nwy) (= 114-6) 
in RPR (§16). Next S(nwz) (= 38-81) and S(nw) (= 23-27) are set in LSL and RSL and 
the latter is divided into S(nwy) which is in RPR; this yields 7 (= 4-9248) in MR and 
B = S(nwxy) —7 .S(nwz) (= 19-56) in LPR, 7is written down (§§ 17, G). A (= 17-56) isset on 
LSL and divided into B, which is in LPR, to give 6 (1-1144) in MR, which is recorded 
(§§ 18, H). Next set 7 (= 4-9248) on SL, and turn it into PR (§ 19). Set b (= 1-1144) on SLand 
multiply by (—Z) (= — 1-6678); this gives Y, (= 3-06) in PR which is recorded (§§ 20, A). The 
MR is now cleared, and when successive values of x are formed into it, the corresponding 
values of Y are formed in PR. These are recorded and form the starting-point of a fresh solu- 
tion (§§ 21-23, B-D). 
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VALUES OF & EQUALLY SPACED (Schedules 3 and 4) 


Take as working units of x the integers from 0 to r inclusive. The basis of this method is the 
fitting of a regression line by successive addition, as given by Fisher (1944, para. 29-2). 
Multiplication by x and x? and subsequent summation is replaced by the formation of second 
and third sums of a function. Thus we can define ,S,(z) as the sum of all values of a function 
z for x>k. The second sum ,8,(z) is similarly defined as the sum of all values of ,,S,(z) for 
«>k, and the third sum ,8,(z) as the sum of all values of ,.S,(z) for x > k. Now it is easily seen 
that 

S(nw) =: oS, (nw), 

S(nwy) = 9S,(nwy), 

S(nwx) = ,S,(nw), 

S(nwx*) = 2,8,(nw) + ,S,(nw), 


S(nway) = ,8,(nwy). 


It will be observed that the individual values of nw and nwy are not required in this process. 
Consequently, it is quicker to accumulate their sums as they are formed in the machine. The 
second and third sums can be formed simultaneously, one on each side of the machine. This 
has two advantages, first the number can be read on one side of the machine and immediately 
set on the other side without copying, and second S(nwz*) and S(nwz) can be caused to appear 
together so that A can be formed while Z is being calculated, as in the previous method. 
A single summation of S(nwy) gives S(nwxy), from which B and 6 are found as usual; fresh 
values of Y are then found, on which to base a check solution, as in the previous method. 

The detailed procedure for this method can now be described. Starting with 2 = r, form 
nw (= 4-04) and nwy (= 26-27) as described above and write them down (§§ 1, 2, A). Without 
clearing PR form into it the second pair of nw and nwy (for x = r—1) (§§3, 4), and write 
down ,_,S,(nw) = 13-65 and ,_,S,(nwy) = 75-66 (§§4, B). Proceed in this manner until the 
whole range of x is covered, when the PR will show )S,(nw) = 23-259 and 9S,(nwy) = 114-66 
(§§ 7, D). Division of the former by the latter gives 7 (§§ 8, E). The sum and second sum of the 
values of ,.S,(nw) must now be found. Set ,S,(nw) = 4:04 on RSL and turn the handle (§ 9). 
Set ,S,(nw) = ,S,(nw) = 4-04 on LSL and ,_,S,(nw) = 13-65 on RSL and turn the handle 
(§10). RPR now shows ,_,S,(nw) = 17-69; this is set into LSL and ,_,S,(nw) = 21-10 into 
RSL. A turn of the handle gives ,_,S,(nw) = 21-73 in LPR and ,_,S,(nw) = 38-79 in RPR 
(§11). Continue this process, setting on LSL what appears on RPR, and on RSL the next 
value of ,S,(nw), until ,S,(nw) has been added into RPR (this stage is reached after § 11). 
Then add successively to LPR, first what is already in LPR (= 21-73) (§ 12), and then what 
isin RPR (= 38-79) (§ 13). LPR and RPR now contain S(nwa*) = 82-25 and S(nwx) = 38-79 
respectively (§ 13). Leaving S(nwx) set in LSL set S(nw) = 23-26 in RSL and divide the latter 
into RPR to give = 1-6677 in MR and A = 17-56 in LPR; write these down and clear the 
machine (§§ 14, F). Next ,S,(nwy) is formed by adding together all values of ,.S,(nwy) down to 
z= 1 (§§ 15-17), and from this is subtracted )S,(nwy) = 114-56 multiplied by 7 = 1-6677. 
This gives B = 19-55 (§18), which is divided by A = 17-56 to give b = 1-1138 (§19). The 
remaining steps are identical with those of the previous method. 

It is a disadvantage of these methods that no convenient way of obtaining S(nwy*) exists, 
but frequently small expectations in some groups make it necessary to regroup before 
calculating x”; and in such cases S(nwy*) is not wanted. Where necessary, nwy* could be 
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obtained from (nwy)?/nw. It is usually preferable to calculate x? from the difference between 
expectation and observation in each group or collection of groups. The values of P in the 
table are used for this purpose. 















































Schedule 1 
x 8 d Y nw . mwy Y 
§A 3 1 14 6-5 4-04 26-3 6-40 
§B 2 7 9 5-4 9-62 49-4 5-30 
§C 1 10 4 4:3 7-45 33-0 4:18 
§D 0 12 0 3-2 2-16 5-9 3-06 
§E S(nw) = 23-27 S(nwz) = 38-81 
§F Z= 1-6678 A=17-56 
§G y= 49248 
§H b= 1/1144 
Schedule 2 
Set Operation PR shows Write Clear 
§ 1 268/99981 xl —_ nw n — 
2 269/00189 x14 4035/02627 4-04 26-3 All 
; 3 601/00217 x7 —_ — 
4 601/00380 x9 9616/04939 9-62 49-4 All 
5 532/00187 x10 = —_ -— 
6 532/00358 x4 7448/03302 7-45 33-0 All 
7 180/00049 x12 2160/00588 2-16 5-9 All 
& 900/00300 x 4:04 = — -— 
9 400/00200 x 9-62 — — _ 
10 100/00100 x 7°45 os S(nw) S(nwz) a 
ll 0/00000 x 2-16 8229/03881 23-27 38-81 MR 
$12 3881/02327 Divide RPR 1756/26820 + 1-6678 17-56 All 
13 300/00100 x 26-3 — (2) (A) MR 
14 200/00100 x 49-4 — — MR 
15 100/00100 x 33-0 — — MR 
16 0/00100 x 5-9 21070/11460 —_— MR 
17 3881/02327 Divide RPR 1956/85119+ ¥ = 49248 MR 
18 1756/ 0 Divide LPR — b=1-1144 All 
19 49248 xl — — MR 
20 11144 x — 1-6678 30662 + Y,= 3-06 MR 
21 11144 xl 41806 + Y,=4:18 a 
$ 22 11144 xl 52950 + Y,= 5-30 = 
$ 23 11144 xl 64094 + Y,= 6-40 All 


























CALCULATION OF TABLE 


The expectations have been taken from Pearson’s Tables (1942). The weights were sub- 
tabulated from those given by Fisher & Yates (1943) and have been checked against the 
table of Finney & Stevens (1948). Every fifth weighted probit was computed to 4 deciraals 
from 4-decimal values of the probits taken from the above tables and weights to 5 or 6 
significant figures, taken partly from Fisher & Yates, partly from a manuscript table lent by 
Dr Finney, and partly calculated from the Federal Works Project Administration Tables 
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et ween (1942). Intermediate values of the weighted probits were obtained by subtabulation. 
> in the Extreme precautions have not been taken against the occurrence of rounding-off errors just 
greater than half a unit of the last decimal given, but they can hardly exceed 0-7 of this unit. 
Schedule 3 
x 8 d y S(nw) S(nwy) ¥ 
§A 3 1 14 6-5 4:04 26-27 6-40 
§B 2 7 9 5-4 13-65 75-66 5-30 
§C 1 10 4 4:3 21-10 108-68 4:18 
§D 0 12 0 3-2 23-26 114-56 3-06 
§E y= 4-9252 
§F" #=1-6677 A=17-56 
§G b=1-1138 
Schedule 4 
Set Operation PR shows Write Clear 
Clear 
| $1 268/999981 x1 is S(nw)  S(nwy) ~ 
§ 2 269/000189 x14 4035/002627 4-04 26-27 MR 

_ § 3 601/000217 x7 - ae ins 
All 4 601/000380 x9 13651/007566 13-65 75-66 MR 

hed 5 532/000187 x 10 — _ — 

All 6 532/000358 x4 21099/010868 21-10 108-68 MR 

— r 180/000049 x 12 23259/011456 23-26 114-56 MR 
All 8 2326 Divide RPR — y = 4-9252 All 
All 9 404 xl 404 —_ —_ 

= 10 404/01365 xl 404/01769 — — 

— ll 1769/02110 xl 2173/03879 — — 

a 12 2173/ 0 xl 4346/03879 _— — 
MR 13 3879/ 0 x1 8225/03879 z A MR 
All § 14 3879/02326 Divide RPR 1755/99169 + 1-6677 17-56 All 
MR 15 2627 xl _ = — 
MR 16 7566 xl _ mal — 
MR 17 10868 xl —_ os — 
MR 18 11456 x — 1-6677 1955 + aa MR 
MR 19 1756 Divide —_— b=1-1133 All 
All 20 49252 xl —_ at — 
MR 21 11138 x — 16677 30677 + Y,= 3-06 MR 
MR 22 11138 xl 41815+ Y,=418 —_— 

a } 23 11138 xi 52953 + Y,= 5-30 — 

— 3 24 11138 xl 64091 + Y,=6-40 All 
All 
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Mini- Maxi- Mini- Maxi- 
Probit ae agg Weight | mum mum | Probit |=*Pect®- Weight | mum mum 

ion tion 

¥ P w score score sf P w score score 
WY WYm WYo WYm 
1-00 0-000 0-001 0-000 4-226 2-00 0-001 0-015 0-025 3-312 
1-02 0-000 0-001 0-000 4-207 2-02 0-001 0-015 0-026 3-296 
1-04 0-000 0-001 0-001 4-188 2-04 0-002 0-016 0-028 3-279 
1-06 0-000 0-001 0-001 4-169 2-06 0-002 0-017 0-030 3-263 
1-08 0-000 0-001 0-001 4-150 2-08 0-002 0-018 0-032 3-246 
1-10 0-000 0-001 0-001 4-131 2-10 0-002 0-019 0-034 3-230 
1-12 0-000 0-001 0-001 4-112 2-12 0-002 0-020 0-036 3-214 
1-14 0-000 0-001 0-001 4-093 2-14 0-002 0-021 0-038 3-198 
1-16 0-000 0-001 0-001 4-074 2-16 0-002 0-022 0-041 3-183 
1-18 0-000 0-001 0-001 4-056 2-18 0-002 0-023 0-043 3-167 
1-20 0-000 0-001 0-001 4-037 2-20 0-003 0-025 0-046 3-152 
1-22 0-000 0-001 0-001 4-018 2-22 0-003 0-026 0-049 3-137 
1-24 0-000 0-001 0-001 3-999 2-24 0-003 0-027 0-052 3-122 
1-26 0-000 0-001 0-001 3-980 2-26 0-003 0-029 0-055 3-107 
1-28. 0-000 0-002 0-002 3°961 2-28 0-003 0-030 0-058 3-092 
1-30 0-000 0-002 0-002 3-943 2-30 0-003 0-031 0-062 3-078 
1-32 0-000 0-002 0-002 3-924 2-32 0-004 0-033 0-065 3-064 
1-34 0-000 0-002 0-002 3-905 2-34 0-004 0-035 0-069 3-050 
1-36 0-000 0-002 0-002 3°886 2-36 0-004 0-036 0-073 3-036 
1-38 0-000 0-002 0-002 3-868 2-38 0-004 0-038 0-077 3-023 
1-40 0-000 0-002 0-003 3-849 2-40 0-005 0-040 0-082 3-010 
1-42 0-000 0-003 0-003 3-830 2-42 0-005 0-042 0-086 2-997 
1-44 0-000 0-003 0-003 3-812 2-44 | C-005 0-044 0-091 2-984 
1-46 0-000 0-003 0-003 3-793 2-46 | (006 0-046 0-096 2-971 
1-48 0-000 0-003 0-004 3°775 2-48 | 6-006 0-048 0-101 2-959 
1-50 0-000 0-003 0-004 3-756 2-50 0-006 0-050 0-107 2-947 
1-52 0-000 0-003 0-004 3-738 2°52 0-007 0-052 0-112 2-936 
1-54 0-000 0-004 0-005 3-719 2°54 0-007 0-054 0-118 2-924 
1-56 0-000 0-004 0-005 3:701 2-56 0-007 0-057 0-125 2-913 
1-58 0-000 0-004 0-006 3-683 2-58 0-008 0-059 0-131 2-903 
1-60 0-000 0-005 0-006 3-664 2-60 0-008 0-062 0-138 2-892 
1-62 0-000 0-005 0-006 3-646 2-62 0-009 0-064 0-145 2-882 
1-64 0-000 0-005 0-007 3-628 2-64 0-009 0-067 0-152 2-872 
1-66 0-000 0-005 0-008 3-610 2-66 0-010 0-070 0-160 2-863 
1-68 0-000 0-006 0-008 3-592 2-68 0-010 0-073 0-167 2-854 
1-70 0-000 0-006 0-009 3-574 2-70 0-011 0-076 0-176 2-846 
1-72 0-001 0-007 0-009 3-556 2-72 0-011 0-079 0-184 2-837 
1-74 0-001 0-007 0-010 3-538 2-74 0-012 0-082 0-193 2-830 
1-76 0-001 0-007 0-011 3-520 2-76 0-013 0-085 0-202 2-822 
1-78 0-001 0-008 0-012 3-502 2-78 0-013 0-088 0-211 2-815 
1-80 0-001 0-008 0-013 3-484 2-80 0-014 0-092 0-221 2-808 
1-82 0-001 0-009 0-013 3-467 2-82 0-015 0-095 0-231 2-802 
1-84 0-001 0-009 0-014 3-449 2-84 0-015 0-099 0-242 2-797 
1-86 0-001 0-010 0-015 3-432 2-86 0-016 0-103 0-252 2-791 
1-88 0-001 0-010 0-017 3-414 2-88 0-017 0-106 0-263 2-786 
1-90 0-001 0-011 0-018 3-397 2-90 0-018 0-110 0-275 2-782 
1-92 0-001 0-012 0-019 3-380 2-92 0-019 0-114 0-287 2-778 
1-94 0-001 0-012 0-020 3-363 2-94 0-020 0-118 0-299 2-774 
1-96 0-001 0-013 0-022 3-346 2-96 0-021 0-122 0-312 2-771 
1-98 0-001 0-014 0-023 3-329 2-98 0-022 0-127 0-325 2-769 
2-00 0-001 0-015 0-025 3-312 3-00 0-023 0-131 0-338 2-767 
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Mini- Maxi- Mini- Maxi- 
Probit ——— Weight | mum mum | Probit —— Weight | mum mum 
¥ P w score score P w score score 

WYo WYm WYo WYm 

3-00 0-023 0-131 0-338 2-767 4-00 0-159 0-439 1-467 3-280 
3-02 0-024 0-136 0-352 2-765 4-02 0-164 0-445 1-495 3-299 
3-04 0-025 0-140 0-366 2-764 4-04 0-169 0-452 1-523 3-319 
3-06 0-026 0-145 0-381 2-763 4-06 0-174 0-458 1-551 3-339 
3-08 0-027 0-150 0-396 2-763 4-08 0-179 0-465 1-579 3-359 
3-10 0-029 0-154 0-411 2-763 4-10 0-184 0-471 1-607 3-379 
3-12 0-030 0-159 0-427 2-764 4-12 0-189 0-478 1-634 3-399 
3-14 0-031 0-164 0-443 2-766 4-14 0-195 0-484 1-662 3-419 
3-16 0-033 0-169 0-460 2-768 4-16 0-200 0-490 1-689 3-438 
3-18 0-034 0-175 0-477 2-770 4-18 0-206 0-497 1-716 3-458 
3-20 0-036 0-180 0-494 2-773 4-20 0-212 0-503 1-743 3-478 
3-22 0-038 0-185 0-512 2:777 4-22 0-218 0-509 1-770 3-498 
3-24 0-039 0-191 0-530 2-781 4-24 0-224 0-514 1-796 3-518 
3-26 0-041 0-196 0-549 2-785 4-26 0-230 0-520 1-823 3-537 
3-28 0-043 0-202 0-568 2-790 4-28 0-236 0-526 1-848 3-557 
3-30 0-045 0-208 0-587 2-796 4-30 0-242 0-532 1-874 3-576 
3-32 0-046 0-214 0-607 2-802 4-32 0-248 0-537 1-899 3-595 
3-34 0-048 0-219 0-627 2-809 4-34 0-255 0-542 1-924 3-614 
3°36 0-051 0-225 0-648 2-816 4-36 0-261 0-548 1-948 3-633 
3-38 0-053 0-231 0-669 2-824 4-38 0-268 0-553 1-972 3-652 
3-40 0-055 0-238 0-690 2-832 4-40 0-274 0-558 1-996 3-670 
3-42 0-057 0-244 0-712 2-840 4-42 0-281 0-563 2-019 3-688 
3-44 0-059 0-250 0-734 2-850 4-44 0-288 0-568 2-041 3-705 
3-46 0-062 0-256 0-757 2-859 4-46 0-295 0-572 2-063 3-722 
3-48 0-064 0-263 0-780 2-870 4-48 0-302 0-577 2-084 3-739 
3-50 0-067 0-269 0-803 2-880 4-50 0-309 0-581 2-105 3-756 
3-52 0-069 0-276 0-827 2-892 4-52 0-316 0-585 2-126 3-772 
3°54 0-072 0-282 0-851 2-903 4-54 0-323 0-589 2-145 3-787 
3°56 0-075 0-289 0-875 2-915 4-56 0-330 0-593 2-164 3-802 
3°58 0-078 0-295 0-899 2-928 4-58 0-337 0-597 2-183 3-817 
3-60 0-081 0-302 0-924 2-941 4-60 0-345 0-601 2-200 3-831 
3-62 0-084 0-309 0-950 2-955 4-62 0-352 0-604 2-218 3-845 
3-64 0-087 0-315 0-975 2-969 4-64 0-359 0-607 2-234 3-858 
3-66 0-090 0-322 1-001 2-983 4-66 0-367 0-610 2-249 3-870 
3-68 0-093 0-329 1-027 2-998 4-68 0-374 0-613 2-264 3-882 
3-70 0-097 0-336 1-053 3-013 4-70 0-382 0-616 2-278 3-894 
3°72 0-100 0-343 1-080 3-029 4-72 0-390 0-619 2-292 3-905 
3°74 0-104 0-350 1-106 3-045 4:74 0-397 0-621 2-304 3-915 
3-76 0-107 0-357 1-133 3-061 4:76 0-405 0-623 2-316 3°924 
3°78 0-111 0-363 1-160 3-078 4-78 0-413 0-625 2-327 3-933 
3-80 0-115 0-370 1-188 3-095 4-80 0-421 0-627 2-337 3-941 
3-82 0-119 0°377 1-215 3-112 4-82 0-429 0-629 2-346 3-948 
3°84 0-123 0-384 1-243 3-130 4-84 0-436 0-631 2-354 3-955 
3°86 0-127 0-391 1-271 3:148 4-86 0-444 0-632 2-361 3-961 
3°88 0-131 0-398 1-299 3-166 4°88 0-452 0-633 2:367 3-966 
3°90 0-136 0-405 1-326 3-184 4-90 0-460 0-634 2-373 3-971 
3°92 0-140 0-412 1-355 3-203 4:92 |- 0-468 0-635 2-377 3-974 
3-94 0-145 0-418 1-383 3-222 4-94 0-476 0-636 2-381 3-977 
3-96 0-149 0-425 1-411 3-241 4-96 0-484 0-636 2-383 3-979 
3°98 0-154 0-432 1-439 3-260 4-98 0-492 0-637 2-385 3-981 
4-00 0-159 0-439 1-467 3-280 5-00 0-500 0-637 2-385 3-981 


















































Weighted probits and their use 






































Mini- Maxi- Mini- Maxi- 
Probit 7 - Weight | mum mum | Probit. a a Weight | mum mum 
b P w score score xy P w score score 
WYo WYm WYo WYm 
5-00 0-500 0-637 2-385 3-981 6:00 0-841 0-439 1-107 2-919 
5-02 0-508 0-637 2-385 3-981 6-02 0-846 0-432 1-059 2-880 
5-04 0-516 0-636 2-383 3-979 6:04 0-851 0-425 1-011 2-841 
5:06 0-524 0-636 2-381 3-977 6-06 0:855 0-418 0-962 2-801 
5-08 0-532 0-635 2-377 3-974 6-08 0-860 0-412 0-913 2-761 
5-10 0-540 0-634 2-372 3-970 6-10 0-864 (405 0-863 2-721 
5-12 0-548 0-633 2-367 3-966 6-12 0-869 0-398 0-813 2-680 
5-14 0-556 0-632 2-360 3-960 6-14 0:873 0-391 0-762 2-639 
5-16 0-564 0-631 2-352 3-953 6-16 0-877 0-384 0-711 2-598 
5-18 0-571 0-629 2-343 3-946 6-18 0-881 0-377 0-660 2-557 
5-20 0-579 0-627 2-333 3-938 6:20 0-885 0-370 0-608 2-515 
5-22 0-587 0-625 2-322 3-928 6-22 0-889 0-363 0-556 2-474 
5-24 0:595 0-623 2-310 3-918 6-24 0-893 0°357 0-504 2-432 
5-26 0-603 0-621 2-297 3-907 6-26 0-896 0°350 0-452 2-390 
5-28 0-610 0-619 2-282 3°895 6-28 0-900 0-343 0-399 2-348 
5:30 0-618 0-616 2-267 3-882 6-30 0-903 0:336 0-346 2-306 
5-32 0-626 0-613 2-251 3-869 6°32 0-907 0-329 0-293 2-264 
5:34 0-633 0-610 2-233 3-854 6-34 0-910 0-322 0-239 2-222 
5-36 0-641 0-607 2-215 3-839 6-36 0-913 0°315 0-186 2-180 
5-38 0-648 0-604 2-195 3-822 6-38 0-916 0-309 0-132 2-138 
5-40 0-655 0-601 2-174 3°805 6-40 0-919 0-302 0-079 2-096 
5-42 0-663 0-597 2-152 3-786 6°42 0-922 0°295 0-025 2-054 
5-44 0-670 0-593 2-129 3-767 6-44 0-925 0-289 99-971 2-012 
5-46 0-677 0°589 2-105 3-747 6 46 0-928 0-282 99-918 1-970 
5-48 0-684 0-585 2-080 3-726 6-48 0-931 0-276 99-864 1-929 
5-50 0-691 0-581 2-054 3-705 6°50 0-933 0-269 99-810 1-888 
5-52 0-698 0-577 2-027 3-682 6-52 0-936 0-263 99-757 1-847 
5:54 0-705 0-572 1-999 3-659 6°54 0-938 0-256 99-703 1-806 
5-56 0-712 0-568 1-970 3-634 6°56 0-941 0-250 99-650 1-765 
5-58 0-719 0:563 1-940 3-609 6°58 0-943 0:244 99-597 1-725 
5-60 0-726 0-558 1-909 3-583 6-60 0-945 0-238 99-544 1-685 
5-62 0-732 0-553 1-877 3°557 6-62 0-947 0-231 99-491 1-645 
5-64 0-739 0-548 1-844 3-529 6-64 0-949 0-225 99-438 1-606 
5-66 0°745 0-542 1-810 3-501 6-66 0-952 0-219 99-386 1-567 
5-68 0°752 0°537 1-775 3-472 6-68 0-954 0-214 99-333 1-529 
5-70 0-758 0-532 1-740 3-442 6-70 0-955 0-208 99-281 1-490 
5°72 0-764 0-526 1-703 3-411 6-72 0-957 0-202 99-230 1-452 
5°74 0-770 0-520 1-665 3-380 6°74 0-959 0-196 99-178 1-415 
5-76 0-776 0-514 1-627 3-348 6-76 0-961 0-191 99-127 1-378 
5°78 0-782 0-509 1-588 3-316 6-78 0-962 0-185 99-077 1-342 
5-80 0-788 0-503 1-548 3-283 6-80 0-964 0-180 99-026 1-306 
5-82 0-794 0-497 1-507 3-249 6-82 0-966 0-175 98-976 1-270 
5°84 0-800 0-490 1-465 3-214 6°84 0-967 0-169 98-927 1-235 
5°86 0-805 0-484 1-423 3-179 6-86 0-969 0-164 98-877 1-200 
5-88 0-811 0-478 1-380 3-144 6-88 0-970 0-159 98-829 1-166 
5-90 0-816 0-471 1-336 3-108 6-90 0-971 0-154 98-780 1-133 
5-92 0-821 0-465 1-291 3-071 6-92 0-973 0-150 98-732 1-100 
5-94 0-826 0-458 1-246 3-034 6°94 0-974 0-145 98-685 1-067 
5-96 0-831 0-452 1-200 2-996 6-96 0-975 0-140 98-637 1-035 
5-98 0-836 0-445 1-154 2-958 6-98 0-976 0-136 98-591 1-004 
6-00 0-841 0-439 1-107 2-919 7-00 0-977 0-131 98-545 0-973 
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A. N. Brack 167 
Mini- Maxi- Mini- Maxi- 
Probit  — Weight | mum mum | Probit Expecta Weight | mum mum 
7 P w score score ¥ “_ w score score 

WYo WY m WYo Wyn 

7-00 0-977 0-131 98-545 0-973 8-00 0-999 0-015 96-833 0-121 
7-02 0-978 0-127 98-499 0-943 8-02 0-999 0-014 96-809 0-115 
7-04 0-979 0-122 98-454 0-913 8-04 0-999 0-013 96-785 0-109 
7:06 0-980 0-118 98-409 0-884 8-06 0-999 0-012 96-761 0-103 
7:08 0-981 0-114 98-365 0-856 8-08 0-999 0-012 96-737 0-098 
7:10 0-982 0-110 98-321 0-828 8-10 0-999 0-011 96-713 0-093 
7°12 0-983 0-106 98-278 0-800 8-12 0-999 0-010 96-690 0-088 
7-14 0-984 0-103 98-235 0:774 8-14 0-999 0-010 | 96-667 0-083 
7-16 0-985 0-099 98-192 0:°747 8-16 0-999 0-009 96-644 0-079 
7-18 0-985 0-095 98-151 0-722 8-18 0-999 0-009 96-621 0-074 
7-20 0-986 0-092 98-109 0-697 8-20 0-999 0-008 96-598 0-070 
7°22 0-987 0-088 98-069 0-673 8-22 0-999 0-008 96-576 0-066 
7°24 0-987 0-085 98-028 0-649 8-24 0-999 0-007 96-554 0-063 
7-26 0-988 0-082 97-989 0-626 8-26 0-999 0-007 96-531 0-059 
7-28 0-989 0-079 97-949 0-603 8-28 0-999 0-007 96-510 0-056 
7-30 0-989 0-076 97-911 0-581 8-30 1-000 0-006 96-488 0-053 
7°32 0-990 0-073 97-872 0-559 8-32 1-000 0-006 96-466 0-050 
7°34 0-990 0-070 97-835 0-538 8-34 1-000 0-005 96-445 0-047 
7°36 0-991 0-067 97-798 0-518 8-36 1-000 0-005 96-423 0-044 
7°38 0-991 0-064 97-761 0-498 8-38 1-000 0-005 96-402 0-042 
7:40 0-992 0-062 97-725 0-479 8-40 1-000 0-005 96-381 0-039 
7-42 0-992 0-059 97-689 0-460 8-42 1-000 0-004 96-360 0-037 
7-44 0-993 0-057 97-654 0-442 8-44 1-000 0-004 96-339 0-035 
7-46 0-993 0-054 97-619 0-425 8-46 1-000 0-004 96-318 0-033 
7-48 0-993 0-052 97-585 0-408 8-48 1-000 0-003 96-297 0-031 
7-50 0-994 0-050 97°551 0-391 8-50 1-000 0-003 96-276 0-029 
7-52 0-994 0-048 97-517 0:375 8-52 1-000 0-003 96-256 0-027 
7-54 0-994 0-046 97-484 0-359 8-54 1-000 0-003 96-235 0-025 
7°56 0-995 0-044 97-452 0:344 8-56 1-000 0-003 96-215 0-024 
7-58 0-995 0-042 97-420 0-330 8-58 1-000 0-003 96-195 0-022 
7-60 0-995 0-040 97-388 0-316 8-60 1-000 0-002 96-174 0-021 
7-62 0-996 0-038 97-357 0-302 8-62 1-000 0-002 96-154 0-020 
7-64 0-996 0-036 97-326 0-289 8-64 1-000 0-002 96-134 0-018 
7-66 0-996 0-035 97-296 0-277 8-66 1-000 0-002 96-114 0-017 
7:68 0-996 0-033 97-266 0-264 8-68 1-000 0-002 96-094 0-016 
7:70 0-997 0-031 97-236 0-252 8-70 1-000 0-002 96-074 0-015 
7-72 0-997 0-030 97-207 0-241 8-72 1-000 0-002 96-054 0-014 
7-74 0-997 0-029 97-178 0-230 8-74 1-000 0-001 96-034 0-013 
7°76 0-997 0-027 97-150 0-220 8-76 1-000 0-001 96-015 0-012 
7-78 0-997 0-026 97-122 0-209 8-78 1-000 0-001 95-995 0-011 
7°80 0-997 0-025 97-094 0-200 8-80 1-000 0-001 95-975 0-011 
7-82 0-998 0-023 97-066 0-190 8-82 1-000 0-001 95-955 0-010 
7°84 0-998 0-022 97-039 0-181 8-84 1-000 0-001 95-936 0-009 
7-86 0-998 0-021 97-013 0:173 8-86 1-000 0-001 95-916 0-009 
7°88 0-998 0-020 96-986 0-164 8-88 1-090 0-001 95-896 0-008 
7:90 0-998 0-019 96-960 0-156 8-90 1-000 0-001 95-877 0-008 
7-92 0-998 0-018 96-934 0-149 8-92 1-000 0-001 95-857 0-007 
7-94 0-998 0-017 96-909 0-141 8-94 * 1-000 0-001 95-838 0-006 
7-96 0-998 0-016 96-883 0-134 8-96 1-000 0-001 95-818 0-006 
7-98 0-999 0-015 96-858 0-127 8-98 1-000 0-001 95-799 0-006 
8-00 0-999 0-015 96-833 0-121 9-00 1-000 0-001 95-779 0-005 
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TABLE OF THE PROBABILITY INTEGRAL OF THE t-DISTRIBUTION 
By H. O. HARTLEY anp E. S. PEARSON 


1. OTHER TABLES 


The first table of the probability integral of this distribution was included by ‘Student’ in 
his original memoir (1908); this table was later extended (‘Student’, 1917). In both cases 
the argument used was z = ¢/,/v, where t is the ratio of a normal deviate to an independent 
estimate of its standard deviation based on v degrees of freedom. When later the very wide 
applications of the distribution were realized a new table was calculated by ‘Student’ at 
R. A. Fisher’s suggestion, using ¢ as argument. This table, calculated to 4 decimal places 
in the probability and for v = 1(1)20, was first published in Metron (1925) and has since 
been reproduced in various forms. In addition to the probability integral, several tables of 
percentage points of t have also been published, the basic table being that of R. A. Fisher (1925). 


2. THE PRESENT TABLE 


The accompanying table represents an extension of ‘Student’s’ (1925) table to a finer interval 
and higher accuracy. It gives the probability integral of ¢ for v degrees of freedom, namely, 


P(t,v) = (r=) ran dary} [ (1+7?/v)-#*) dr (1) 
to 5 places of decimals, for x 
y = 1(1)20, vy = 20(1) 24, 30, 40, 60, 120, co, 
{ = 0-0(0-1) 4-0(0-2) 8-0, °” ( = 0-00(0-05) 2-0(0-1) 4-0, 5-0. 


In the present arrangement, which covers three pages, the slowly convergent tail of the 
distribution has been sacrificed for small v in order to keep the tabular ¢ interval uniform for 
all v below 20. To cover the tail region, a few landmarks are provided at the bottom of p. 171 
in the form of percentage points; other values may be readily obtained from the approximate 


formula 1—P(t,v) = c,t”, (2) 
with the c, given below: 

v 1 | 2 3 f 5 | 6 | 7 

c, 0317 | 0-488 | 1:04 | 27 | 82 | 26 | 84 








For v = 1, only 4 accurate decimals are given by (2), but since 
P(t, 1) = 7m tan! t+ 4, (3) 
more accurate values can be obtained from tables of the inverse tangent, if required. Where 


the table terminates before the bottom of a column is reached, the entry in the first blank 
space is 1-00 000 to 5-decimal accuracy. 


3. METHODS OF SINGLE-ENTRY INTERPOLATION 


Since no differences are provided in the table, a brief discussion of Lagrangian interpolation 
formulae is appropriate. Let t_,, t,t; denote three consecutive tabular arguments such that 


to<t<t,, and let P, = P(t,,v); 0 = (t—t)/(t, -t). 








Then 


In us 
40 an 
apply 
can hb 


Inte 
table 


ON 


the 
for 
171 
ate 


(2) 


(3) 
ere 
unk 


ion 
hat 





H. O. Hartiey anp E. 8. Pearson 169 


Then we have the following formulae: 
(Linear) P(t,v)~P(1—-9)+ P84, (4) 
(3-point) P(t, v) ~~ P_,(36— 40) + Py(1— 6%) + Py(46? + 46). (5) 
In using (5) with a calculating machine, it may be found convenient first to form and copy 
46 and 40? and then to compute the sum of products (5), setting the P; as multiplicands and 
applying the terms inside each bracket ( ) in turn as multipliers. Alternatively, the multipliers 
can be read from a table of 3-point Lagrangian coefficients, if available. 
The accuracy of interpolation is, approximately, shown below: 


l<v<20; 0<t<4 Linear Lagrangian (-wise 3 units in 4th decimal 
l<v<20; 4<t | 4 units in 5th decimal 
20<v<ao; 0<t<2 8 units in 5th decimal 
20<v<co; 2<t | 12 units in 5th decimal 
all v, all ¢ 3-point Lagrangian t-wise 1 unit in 5th decimal 
20<v<oo; allt Linear harmonic v-wise 1 unit in 5th decimal 


4. DoUBLE-ENTRY INTERPOLATION 


Interpolation to fractional y may sometimes be required, as, for instance, when using the 

table to compute the probability integral of the general Pearson Type VII frequency curve 
T'(m) ( =) 

y= pa oe 6 

Se) = erm tas (6) 

Here we can obtain | f(x)dx by entering the present table with v = 2m—1, t = x Jvja, 


and double-entry interpolation becomes necessary. For most practical purposes double- 
linear interpolation will be adequate. 

Let 4<v = 2m—1< 24 and let v, and v, denote two consecutive tabular v such that 
¥y9<v<v,. Then compute ¢ = v—Vp, 0 as defined above and 0¢; hence the interpolate 


P(t, v) = Poo(1-O—$ + 89) + Pyo(9 — 99) + Pod — 96) + Px 99, (7) 
where P,, = P(t,;,v;). If v>24 the same formula may be used, defining ¢ harmonically by 
¢ = 120(v, —v)/(v,v) and interchanging vy, and v, in (7). If v< 4 it may be preferable to obtain 
P(t, v) directly by numerical quadrature. 


5. COMPUTATION OF THE TABLE 


For v = 1, the values were directly computed from (3) and for vy = 2 from 

P(t, 2) = $4(2+@)-#+ 4. (8) 
The tables for 3 < v < 120 were computed on the National machine by a method of numericai 
quadrature described by Hartley (1947). For the computational work we are indebted to 
the expert help of the National Physical Laboratories. 
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1 2 3 + 5 6 7 8 9 10 
0-0 | 0:50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 
0-1 -53173 *53527 53667 -53742 -53788 -53820 53843 -53860 53873 53884 
0-2 56283 -57002 -57286 -57438 -57532 -57596 *57642 57676 *57704 -57726 
0-3 *69277 -60376 *60812 61044 -61188 *61285 -61356 *61409 *61450 *61484 
0-4 62112 -63608 *64203 64520 64716 *64850 *64946 -65019 -65076 *65122 
0-5 | 064758 | 0-66667 | 0-67428 | 0-67834 | 0-68085 | 0-68256 | 0-68380 | 0-68473 | 0-68546 | 0-68605 
0-6 -67202 *69529 -70460 70958 *71267 ‘71477 -71629 *71745 *71835 *71907 
0-7 *69440 *72181 *73284 *73875 *74243 *74493 *74674 *74811 *74919 -75006 
0-8 -71478 *74618 *75890 *76574 *76999 *717289 -77500 *77659 *717784 *77885 
0-9 *73326 *76845 *78277 -79050 ‘79531 -79860 -80099 -80280 *80422 “80536 
1-0 | 0-75000 | 0-78868 | 0-80450 | 0-81305 | 0-81839 | 0-82204 | 0-82469 | 0-82670 | 0-82828 | 0-82955 
1-1 “76515 -80698 “82416 *83346 *83927 *84325 *84614 "84834 *85006 *85145 
1-2 *17886 *82349 *84187 “85182 *85805 *86232 *86541 “86777 *86961 *87110 
13 *79129 83838 *85777 *86827 *87485 *87935 *88262 “88510 *88705 *88862 
1-4 “80257 85177 -87200 “88295 -88980 *89448 -89788 -90046 -90249 *90412 
1-5 | 081283 | 0-86380 | 0-88471 | 0-89600 | 0-90305 | 0-90786 | 0-91135 | 0-91400 | 0-91608 | 0-91775 
1-6 *82219 -87464 -89605 -90758 ‘91475 -91964 -92318 *92587 -92797 -92966 
1-7 “83075 *88439 -90615 -91782 92506 92998 *93354 *93622 93833 *94002 
1-8 *83859 *89317 -91516 92688 -93412 -93902 *94256 94522 *94731 -94897 
1-9 “84579 -90109 -92318 93488 -94207 -94691 -95040 -95302 *95506 -95669 
2-0 | 0°85242 | 0-90825 | 0-93034 | 0-94194 | 0-94903 | 0-95379 | 0-95719 | 0-95974 | 0-96172 | 0-96331 
2-1 *85854 *91473 *93672 -94817 *95512 95976 96306 *96553 *96744 *96896 
2-2 86420 -92060 94241 -95367 -96045 -96495 -96813 -97050 97233 -97378 
2-3 “86945 -92593 *94751 *95853 ‘96511 96945 -97250 -97476 ‘97650 ‘97787 
2-4 *87433 *93077 -95206 *96282 ‘96919 97335 -97627 97841 *98005 98134 
2-5 | 087888 | 0-93519 | 0-95615 | 0-96662 | 0-97275 | 0-97674 | 0-97950 | 0-98153 | 0-98307 | 0-98428 
2-6 *88313 *93923 *95981 -96998 *97587 ‘97967 -98229 -98419 *98563 -98675 
2-7 *88709 *94292 96311 *97295 ‘97861 -98221 -98468 -98646 -98780 -98884 
2-8 *89081 *94630 -96607 *97559 *98100 -98442 -98674 -98840 -98964 -99060 
2-9 *89430 *94941 -96875 -97794 -98310 -98633 -98851 -99005 -99120 *99208 
3-0 | 0:89758 | 0-95227 | 0-97116 | 0-98003 | 0-98495 | 0-98800 | 0-99003 | 0-99146 | 0-99252 | 0-99333 
3-1 -90067 *95490 -97335 ‘98189 *98657 -98944 *99134 -99267 -99364 *99437 
3-2 *90359 *95733 -97533 *98355 -98800 -99070 *99247 -99369 *99459 *99525 
3-3 90634 *95958 ‘97713 -98503 -98926 -99180 -99344 *99457 -99539 *99599 
3-4 *90895 96166 ‘97877 -98636 -99037 -99275 -99428 -99532 -99606 -99661 
3-5 | 0-91141 | 0-96358 | 0-98026 | 0-98755 | 0-99136 | 0-99359 | 0-99500 | 0-99596 | 0-99664 | 0-99714 
3-6 -91376 ‘96538 98162 -98862 -99223 -99432 99563 -99651 -99713 -99758 
3-7 *91598 -96705 -98286 -98958 -99300 -99496 -99617 -99698 *99754 -99795 
3-8 -91809 -96860 “98400 99045 -29369 99552 -99664 -99738 -99789 -99826 
3-9 -92010 *97005 *98504 -99123 -99430 -99601 -99705 -99773 -99819 *99852 
4-0 | 0-92202 | 0-97141 | 0-98600 | 0-99193 | 0-99484 | 0-99644 | 0-99741 | 0-99803 | 0-99845 | 0-99874 
4-2 -92560 -97386 -98768 *99315 99575 -99716 -99798 -99850 -99885 -99909 
4-4 *92887 -97602 -98912 -99415 “99649 -99772 *99842 -99886 -99914 -99933 
46 93186 -97792 99034 “99498 -99708 -99815 -99876 -99912 99936 -99951 
4:8 *93462 -97962 ‘99140 -99568 -99756 -99850 -89902 -99932 99951 *99964 
5-0 | 0-93717 | 0-98113 | 0-99230 | 0-99625 | 0-99795 | 0-99877 | 0-99922 | 0-99947 | 0-99963 | 0-99973 
5-2 *93952 *98248 ‘99309 ‘99674 -99827 ‘99899 | -99937 -99959 -99972 “99980 
5-4 *94171 -98369 -99378 -99715 -99853 ‘99917 -99950 -99968 -99978 *99985 
5-6 *94375 -98478 99437 -99750 -99875 99931 “99959 -99975 *99983 -99989 
5-8 94565 *98577 -99490 -99780 -99893 -99942 -99967 -99980 -99987 -99991 
6-0 | 0-94743 | 0-98666 | 0-99536 | 0-99806 | 0-99908 | 0-99952 | 0-99973 | 0-99984 | 0-99990 | 0-99993 
6-2 *94910 -98748 ‘99577 -99828 -99920 -99959 -99978 -99987 “99992 “99995 
6-4 “95066 *98822 -99614 *99847 99931 “99966 -99982 -99990 99994 “99996 
6-6 ‘95214 -98890 -99646 -99863 -99940 -99971 *99985 “99992 *99995 -99997 
6-8 *95352 *98953 -99675 -99878 -99948 *99975 -99987 -99993 *99996 -99998 
7-0 | 0-95483 | 0-99010 | 0-99701 | 0-99890 | 0-99954 | 0-99979 | 0-99990 | 0-99994 | 0-99997 | 0-99998 
7-2 *95607 -99063 *99724 -99901 -99960 -99982 -99991 -99995 -99997 -99999 
7-4 ‘95724 “99111 “99745 “99911 -99964 -99984 -99993 -99996 -99998 -99999 
7-6 *95836 99156 -99764 -99920 -99969 99986 -99994 -99997 -99998 -99999 
78 “95941 -99198 ‘99781 99927 -99972 -99988 -99995 *99997 -99999 -99999 
8-0 | 0-96042 | 0-99237 | 0-99796 | 0-99934 | 0-99975 0-99996 | 0-99998 | 0-99999 | 0-99999 
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Table of P(t, v), the probability integral of t (cont.) | 





11 12 13 14 15 16 17 18 19 20 





0-0 | 0-50000 | 0-50000 | 0-50000 | 0:50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 
0-1 -53893 -53900 -53907 -53912 -53917 -53921 -53924 53928 -53930 -53933 
0-2 *57744 -57759 ‘57771 ‘57782 -57792 -57800 -57807 57814 -57820 *57825 © 
0-3 “61511 *61534 *61554 “61571 *61585 -61598 -61609 -61619 -61628 -61636 
0-4 *65159 *65191 *65217 | -65240 -65260 *65278 -65293 65307 -65319 -65330 
0-5 | 0-68654 | 0-68694 | 0-68728 | 0-68758 | 0-68783 | 0-68806 | 0-68826 | 0-68843 | 0-68859 | 0-68873 
0-6 | -71967 -72017 -72059 *72095 *72127 *72155 *72179 *72201 *72220 72238 
0-7 *75077 *75136 *75187 *75230 *75268 *75301 *75330 *75356 -75380 -75400 
0-8 -77968 -78037 -78096 -78146 -78190 *78229 -78263 *78293 -78320 *78344 
0-9 *80630 -80709 -80776 *80833 -80883 *80927 80965 *81000 *81031 *81058 
1:0 | 0-83060 | 0-83148 | 0-83222 | 0-83286 | 0-83341 | 0-83390 | 0-83433 | 0-83472 | 0-83506 | 0-83537 
1-1 *85259 *85355 "85436 *85506 *85566 “85620 *85667 *85709 *85746 *85780 
1-2 *87233 -87335 *87422 *87497 *87562 -87620 *87670 “87715 *87756 “87792 
1-3 “88991 -89099 *89191 -89270 -89339 *89399 “89452 -89500 *89542 *89581 
1-4 *90546 90658 *90754 -90836 -90907 -90970 91025 -91074 *91118 *91158 
1:5 | 0-91912 | 0-92027 | 0-92125 | 0-92209 | 0-92282 | 0-92346 | 0-92402 | 0-92452 | 0-92498 | 0-92538 
1-6 -93105 *93221 -93320 *93404 ‘93478 *93542 93599 93650 -93695 -93736 
1-7 -94140 *94256 94354 94439 94512 *94576 94632 -94683 -94728 -94768 
1-8 *95034 -95148 95245 95328 -95400 -95463 *95518 *95568 ‘95612 *95652 
1-9 *95802 *95914 -96008 -96089 -96158 -96220 -96273 -96321 -96364 -96403 
2-0 | 0-96460 | 0-96567 | 0-96658 | 0-96736 | 0-96803 | 0-96861 | 0-96913 | 0-96959 | 0-97000 | 0-97037 
2-1 -97020 ‘97123 ‘97209 -97283 -97347 -97403 *97452 -97495 *97534 -97569 
2-2 -97496 *97593 -97675 *97745 -97805 -97858 -97904 *97945 *97981 “98014 
2-3 -97898 “97990 -98067 -98132 -98189 -98238 -98281 “98319 98352 “98383 
2-4 *98238 98324 -98396 *98457 *98509 *98554 98594 98629 “98660 -98688 
5 | 0-98525 | 0-98604 | 0-98671 | 0-98727 | 0-98775 | 0-98816 | 0-98853 | 0-98885 | 0-98913 | 0-98938 
6 -98765 -98839 -98900 *98951 -98995 -99033 -99066 -99095 *99121 -99144 
7 -98967 -99035 -99090 -99137 *99177 99211 -99241 -99267 -99290 *99311 
8 -99136 -99198 -99249 -99291 *99327 *99358 *99385 -99408 -99429 *99447 
9 *99278 *99334 *99380 -99418 -99450 *99478 *99502 -99523 *99541 -99557 
0 | 0-99396 | 0-99447 | 0-99488 | 0-99522 | 0-99551 | 0-99576 | 0-99597 | 0-99616 | 0-99632 | 0-99646 
1 *99495 -99541 “99578 | -99608 -99634 -99656 *99675 -99691 -99705 -99718 
2 *99577 -99618 -99652 *99679 -99702 “99721 -99738 *99752 -99764 ‘99775 
3 *99646 -99683 -99713 -99737 -99757 aeres -99789 ‘99801 -99812 -99821 
4 -99703 -99737 -99763 *99784 *99802 *$9817 -99830 ‘99840 “99850 -99858 


0-99751 | 0-99781 | 0-99804 | 0-99823 | 0-99839 | 0:99852 | 0-99863 | 0-99872 | 0:99880 | 0-99887 
-99791 -99818 -99838 *99855 -99869 | 99880 “99890 -99898 *99905 -99911 
*99825 -99848 ‘99867 -99881 -99893 -99903 “99911 99918 *99924 *99929 
*99853 *99874 -99890 “99902 -99913 99921 -99928 99934 *99939 -99944 
-99876 -99895 -99909 -99920 -99929 ‘99936 -99942 99948 *99952 -99956 


0-99896 | 0-99912 | 0-99924 | 0-99934 | 0-99942 | 0-99948 | 0-99954 | 0-99958 | 0:99962 | 0-99965 
-99926 -99938 -99948 “99955 -99961 -99966 -99970 -99973 -99976 -99978 
*99947 *99957 -99964 -99970 -99974 -99978 -99980 “99983 *99985 -99986 
-99962 -99969 *99975 -99979 *99983 -99985 -99987 *99989 -99990 -99991 
-99972 -99978 *99983 -99986 -99988 -99990 -99992 *99993 *99994 -99995 


0-99980 | 0-99985 | 0-99988 | 0-99990 | 0-99992 | 0-99993 | 0:99995 | 0:99995 | 0-99996 | 0-99997 
*99985 -99989 *99992 -99993 -99995 -99996 -99996 -99997 -99997. | -99998 
-99989 -99992 -99994 99995 -99996 -99997 -99998 -99998 -99998 -99999 
-99992 -99994 -99996 -99997 -99997 -99998 -99998 -99999 -99999 -99999 
-99994 -99996 -99997 -99998 -99998 -99999 -99999 -99999 -99999 -99999 


0-99995 | 0-99997 | 0-99998 | 0-99998 | 0-99999 | 0-99999 | 0-99999 | 0:99999 
-99997 -99998 -99998 -99999 -99999 -99999 
-99997 -99998 -99999 -99999 -99999 
-99998 -99999 -99999 -99999 : 
-99998 -99999 -99999 | 
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Upper percentage points of t 



































L~-P v=1 2 3 | 4 5 6 7 8 9 10 
10-3 3183 | 22-33 | 10-21 | 117 5-89 5-21 4:79 | 4:50 | 4:30 | 4:14 
10-4 3183 70-7 22-20 | 13-03 9-68 8-02 7:06 | 644 | 601 | 5-69 
10-5 31831 224 47-91 | 23-33 | 16-54 | 12:03 | 1011 | 890 | 810 | 7:53 
5x 10-* 63652 316 60-40 | 27-82 | 17-89 | 13-55 | 11-22 | 9-79 | 883 | 815 








Table of P(t, v), the probability integral of t (cont.) 
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23 24 30 40 60 120 © 

0-50000 | 0:50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 | 0-50000 
-51969 -51970 | -51971 -51972 -51973 *51977 -51981 51986 -51990 51994 
-53933 53935 53938 53939 -53941 -53950 -53958 53966 | -53974 53983 
-55887 -55890 -55893 55896 -55899 55912 -55924 -55937 -55949 55962 
-57825 -57830 57834 -57838 *57842 -57858 -57875 -57892 -57909 -57926 
0:59743 | 0-59749 | 0-59755 | 0-59760 | 0-59764 | 0-59785 | 0-59807 | 0-59828 | 0-59849 | 0-59871 
-61636 61644 -61650 61656 -61662 61688 -61713 -61739 -61765 61791 

*63500 *63509 *63517 *63524 *63530 63561 63591 *63622 *63652 -63683 | 
*65330 *65340 *65349 *65358 *65365 -65400 65436 *65471 *65507 *65542 
*67122 *67134 -67144 -67154 -67163 -67203 *67243 -67283 -67324 -67364 
0- 0-68873 | 0-68886 | 0-68898 | 0-68909 | 0-68919 | 0-68964 | 0-69009 | 0-69055 | 0-69100 | 0-69146 
0- “70579 *70594 -70607 -70619 -70630 -70680 ‘70731 -70782 -70833 -70884 
0-60 *72238 *72254 -72268 *72281 *72294 *72349 *72405 *72462 *72518 *72575 
0-65 *73846 *73863 -73879 *73893 *73907 -73968 -74030 -74091 *74153 *74215 
0-70 *75400 “75419 *75437 -75453 *75467 *75534 *75601 -75668 *75736 *75804 
0-75 | 0-76901 | 0-76921 | 0-76940 | 0-76957 | 0-76973 | 0-77045 | 0-77118 | 0-77191 | 0-77264 | 0-77337 
0-80 *78344 *78367 778387 -78405 *78422 -78500 -78578 *78657 *78735 *78814 
0-85 -79731 *79754 -79776 -79796 -79814 -79897 *79981 -80065 *80149 -80234 
. 0-90 *8°058 *81084 “81107 | " -81128 *81147 -81236 “81325 “81414 “81504 “81594 
0-95 *82327 *82354 *82378 *82401 *82421 “82515 -82609 *82704 *82799 *82894 
1-00 | 0-83537 | 0-83565 | 0-83591 | 0-83614 | 0-83636 | 0-83735 | 0-83834 | 0-83934 | 0-84034 | 0-84134 
1-05 *84688 *84717 "84744 *84769 *84791 *84895 *84999 “85104 *85209 *85314 
1-10 *85780 “85811 “85839 *85864 *85888 *85996 *86105 “86214 -86323 *86433 
1-15 -86814 *86846 “86875 -86902 86926 *87039 “87151 *87265 *87378 *87493 
1-20 *87792 *87825 *87855 *87882 *87907 *83023 *88140 *88257 “88375 *88493 
0-88714 | 0-88747 | 0-88778 | 0-88807 | 0-88832 | 0-88952 | 0-89072 | 0-89192 | 0-89313 | 0-89435 
“89581 *89616 *89647 -89676 *89703 “89825 89948 -90071 *90195 -90320 
-90395 90431 90463 *90492 *90519 90644 *90770 90896 -91022 -91149 
*91158 -91194 *91227 91257 -91285 ‘91411 -91539 -91667 “91795 -91924 
-91872 -91908 -91942 -91972 -92000 -92128 *92257 -92387 *92517 *92647 
0°92538 | 0:92575 | 0-92608 | 0-92639 | 0-92667 | 0-92797 | 0-92927 | 0-93057 | 0-93188 | 0-93319 
*93159 93196 -93230 -93260 -93289 -93419 *93549 -93680 “93811 *93943 
93736 ‘93773 ‘93807 -93838 93866 -93996 *94127 *94257 -94389 *94520 
*94272 *94309 *94342 *94373 -94401 -94531 -94661 *94792 *94922 *95053 
-94768 *94805 *94839 *94869 *94897 -95026 *95155 95284 “95414 *95543 
0-95228 | 0-95264 | 0-95297 | 0-95327 | 0-95355 | 0-95483 | 0-95611 | 0-95738 | 0-95866 | 0-95994 
*95652 -95688 *95720 -95750 *95778 95904 -96030 -96156 -96281 -96407 
*96043 -96078 *96110 -96140 -96167 -96291 96414 96538 -96661 ‘96784 
-96403 *96437 -96469 -96498 *96524 -96646 *96767 -96888 -97008 -97128 
-96733 -96767 -96798 *96827 *96852 -96971 ‘97089 *97207 ‘97325 97441 
0-97037 | 0-97070 | 0-97100 | 0-97128 | 0-97153 | 0-97269 | 0-97384 | 0-97498 | 0-97612 | 0-97725 
-97569 -97601 -97629 *97655 -97679 ‘97788 -97896 *98003 -98109 *98214 
-98014 *98043 -98070 -98094 -98116 -98218 -98318 -98416 “98514 -98610 
*98383 -98410 98435 *98457 -98478 *98571 -98663 -98753 -98841 -98928 
-98688 -98712 98735 -98756 -98774 -98860 98943 *99024 -99103 -99180 
2-5 0-98938 | 0-98961 |. 0-98982 | 0-99000 | 0-99017 | 0-99094 | 0-99169 | 0-99241 | 0-99312 | 0-993579 
2-6 -99144 “99164 99183 -99200 99215 *99284 99350 99414 99475 *99534 
2-7 99311 -99329 ‘99346 -99361 *99375 99436 99494 *99550 ‘99603 -99653 
2-8 -99447 -99463 ‘99478 -99492 -99504 *99557 -99608 *99657 ‘99702 -99744 
2-9 *99557 *99572 99585 -99596 *99607 99654 -99698 “99740 -99778 -99813 
3-0 099646 | 0-99659 | 0-99670 | 0-99681 | 0-99690 | 0-99730 | 0-99768 | 0-99804 | 0-99836 | 0-99865 
31 -99718 -99729 *99739 -99748 -99756 “99791 -99823 -99853 -99879 -99903 
3-2 *99775 -99785 *99793 -99801 -99808 -99838 *99865 -99890 | -99912 -99931 
3:3 *99821 -99829 -99837 99844 *99849 *99875 -99898 -99918 -99936 99952 
3-4 -99858 99865 *99871 -99877 -99882 99904 -99923 -99940 99954 -99966 
3-5 0-99887 | 0-99893 | 0-99899 | 0-99904 | 0-99908 | 0-99926 | 0-99942 | 0-99956 | 0-99967 | 0-99977 
3-6 “99911 -99916 “99920 99925 -99928 99943 *99957 -99968 -99977 -99984 
3-7 -99929 -99933 99937 -99941 99944 -99957 -99967 -99976 *99984 -99989 
3-8 -99944 99948 -99951 *99954 99956 *99967 -99976 99983 -99989 -99993 
3-9 99956 -99959 -99961 -99964 99966 *99975 *99982 99988 99992 99995 
4-0 0-99965 | 0-99967 | 0-99970 | 0-99972 | 0-99974 | 0-99981 | 0-99987 | 0-99991 | 0-99995 | 0-99997 

5-0 0-99997 | 0-99997 | 0-99998 | 0-99998 | 0-99998 | 0-99999 | 0-99999 
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MISCELLANEA 


A method of estimating the parameters of an autoregressive time-series 
By 8S. G. GHURYE 


The usual method of estimating the parameters of an autoregressive time-series consists in minimizing 
the sum of squared residuals, as in fitting a regression line to a set of variables (Kendall, 19460, p. 415). 
But there is a certain difference between the two cases, since in the latter each set of values of the variates 
occurs naturally as a set of corresponding values, whereas in the former we have only one sequence of 
single values, each member of which is regarded in turn as a different variate of the regression equation. 
The estimates of the parameters are obtained in terms of product-moment correlation coefficients, which 
in the latter case comprise all of their class, namely, the total correlations of the ‘dependent’ variable 
with the ‘independent’ ones; but in the case of the autoregressive scheme, the correlations involved are 
only the first few of the whole lot of autocorrelations of different orders. It is, therefore, likely that a 
method of estimation which utilizes the information provided by a larger number of autocorrelations of 
the time-series is better than the current procedure. Theoretically, of course, it is possible to choose the 
parameters so as to give the best possible fit between the hypothetical correlogram (sequence of auto- 
correlations) calculated from these values and the actual correlogram obtained from the time-series. 
But the compicated nature of the equations involved renders this scarcely feasible. The present paper 
indicates anviiner way of utilizing the various serial correlations for the estimation of the parameters. 

We consider here a time-series generated by a discrete, linear autoregressive process of the second order 
and subject to superposed variation. Then u,, the value at time ¢ (¢ integral), is given by 


u,= U,4+% (1) 
where 77 (mean zero) is the superposed variation, non-autocorrelated and independent of all other variables, 
and JU, is defined by the relation U, +a. +BUr.=& (t>2), (2) 


in which ¢ is the disturbance function (non-autocorrelatéd, independent of 9 and of all previous u’s, and 
having a zero mean); «, # are constants—the two parameters to be estimated. 

It is assumed that 0<f<1 and a*?<4f, and that the series has started some time prior to the first 
observation, so that the complementary function in the solution of (2) is of negligible value during the 
period under consideration. 

Let U4 (2, B) = y+ Cy, + Py_e = + M+ + PM-2- 

If u, is known for ¢ = 1,2,...,N, % is defined for ¢ = 3,4,...,N and v,,, (k>0) for t= 3—k,...,.N—k. 
We then have N-k 
P,{v(a, £)} = pA v,(a, 8) % (a, 2) 
N-k 
= Pa (E+ Met Xe-1 + Pea) (Cpe + Mere + UMeg ea + Pena) 


On account of the independence properties of ¢ and 7, we get 
E(P{r(a,£)}]} = 0 for k>2. (3) 

If 7 =0, that is to say, if there is no superposed variation, P,(v) and P,(v) also vanish; but otherwise, 
they will in general have non-zero values. 

The property (3) is made use of in the present method of estimating a and £, which consists essentially 
a va, b) =u, + auy_, + bu;_s, (4) 
and finding those values of a,b which reduce all the P,{v(a, b)} (2<‘<somen<N) as near as possible 
to zero. 

In a very long series, the mean of va, b) over any N —k — 2 values (for moderate k) is practically zero, 
so that N-k 
P,{v(a, b)} = Par (Uy + Gtty_y + Dtdy_g) (Upp e + OU y na + Oty, x2). (5) 


But in practice it is more accurate to make allowance for the observed mean, which is done in the usual 
way, regarding v, and v,,, as two distinct variates. We then have 


1 N-k N 
x= »,(a, oi >» w4,b)}. (6) 
3 k+3 


N-k 
P,{r(a, b)}= 2 va, b) U44,(a, b) — ae 
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On substituting for v, from (4), we obtain P,(v) in the form 


P,{v(a, b)} — A,a?+B,0°+C,+D,6+H,a+F;,ab, (7) 
where A,, etc., are expressible in terms of the we product-sums of 1%, e.g. 
i Nye Ss 
A,= ={ 2 ul { © u. 8 
k - Up Ups, — (~_s = z) : = (8) 


Similarly for the other coefficients; as these are readily obtainable from (6), they are not given here. 
When a = a and 5 = #, P,{v(a, £)} (k>2) is the sum of N—k—2 products of uncorrelated numbers, 
so that its variance is roughly proportional to N —k—2. Assuming that the estimated values «,, #, of 
a, B are cn to - true values, we may suppose P,{v(@,, 8,)} to have a variance proportional to N —k—2. 
Then >» Wee Pi{v(a,, 8,)} (any moderate n<N) may be regarded as the sum of the squares of 
k=3 
n— 2 variables, all of equal variance and zero mean. Unless 7 =0, the P’s are not all independent, even 
for a, = a, 8, = f. In this connexion it is to be observed that the independence properties of the forms 
R, of Quenouille (1947) have been proved on the assumption 7 = 0. 
We now choose @,, 8, such as to minimize the sum of squares 


n 
© REE Polen Aa (9) 


Hence, the estimates of «, # must satisfy the pair of equations 


(3) E —_*___ prrw(a,d)} = 0 


Ba’ db) ys (N—k—2) 
n 1 
i.e. 2 ap 8A, Bo" + (BE, + D, F;) 0? +O, 2,} 
k=g(N —k—2) 
+a{2Aja* + (2A, B, + Fi) b* + (2A,C, + Ej) + 2(A,D, + 2, F,) b} 
+{3A,P,a*+ 3B, F,b*+(D,L£,+C,F;,)}] = 0, (10) 
1 ° 
and z —___— [{(A, D, +H, F,,) a* + 3B,D,6?+C,D,} 
=a (N —k—2) 


+a{A,F,a*+3B,F,6*+(D, £,+C,F,) + 2(B,£,+D,F,) 5} 
+b{(2A,B, + Fj) a* + 2Bfb* + (2B, C, + Dj)}] = 0. (11) 


These equations can be solved by iteration, five or six trials being usually quite sufficient. 

The introduction of the weighting coefficients 1/(N —k—2) may appear to be an unnecessary com- 
plication, based only on approximate knowledge. However, it is likely to increase accuracy, while not 
adding much to the labour of computation, since the values A,H,/(N—k— 2), etc., can be obtained 
directly by multiplying A,, HZ, in the left-hand part of the machine and dividing the result in the product 
register by N—k--2. 

Considerable saving in work can be effected (at the cost of some accurecy) by using the respective 
serial correlations in place of the product-sums of u in (7), N—k—2 being used as weighting coefficient 
instead of 1/(N —k—2).* 


—— a 
We Gap satateiee ~ (N —k-2) (Aja* + Bib? + C, + Dib + Eia + Frab)?, (12) 


where Aj = By = Cy = rp, Dy = rpg $7 x49 and By = Py= yi trey 


* As regards the degree of approximation involved in replacing the product-sums by correlations, it 
must be noted that the current method of estimating «, # in terms of r,,r, is based on such an approxi- 
N 


mation; for whereas a, # are supposed to be estimated by minimizing & (u,+au,_,+bu,_,)*, where u, is 


measured from its mean, ry usual expressions for these estimates are derived by making substitutions like 
N-2 
that of r, for 2 Uys = u}. In Wolfer’s series (Example 3 below) the estimates of a, £ obtained directly 


from this minioel ouiaiien are — 1-336 and 0-650 respectively, whereas those in terms of r,, r, are 
— 1-346 and 0-658. The approximation in using correlations in the present method is found to be no worse 
than this. 
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The resulting estimates of « and f, based on a number of serial correlations of the u’s, should be more 
reliable than those based only on two or three. Moreover, they are unaffected by the presence of super- 
posed variation. 

The results of three applications of the method are given below; the first deals with a hypothetical 
series, the second with a specially constructed series and the third with Wolfer’s series of sunspot numbers 
(annual figures as given by Yule, 1927). In all cases, the iteration process was carried on until its further 
continuation would not affect the values of a and b by more than about 0-0003. 

Example 1. The method was first tried (using correlations instead of product-sums) on a sequence of 
serial correlations obtained by multiplying those of Kendall’s experimental series 2 of 240 terms (Kendall, 
1946a, Table 3.3) by 0-8. The resulting values are supposed to have been actually obtained from a series 
having « = — 1-2, # = 0-4 and subject to superposed variation. 

With n = 15 in equation (12), I obtained 


a, =—1:106, £, = 0-364, 
and with n = 28, a, =—1:140, £, = 0-389. 


The usual estimates from 7, r, are @, = — 0-652, 8, = —0-042, and using r,, r2, Tr, for estimation 
(Quenouille, 1947, p. 126) we get a, = 


— 1-344, £, = 0-547. The improvement due to the present 
method is evident. 
Example 2. An autoregressive series of the type defined by (1) and (2) was specially constructed for 
the purpose of analysis, and the present method was applied in both the exact and approximate forms 
(9) and (12). The series, of 175 terms, is given in Table 1. 


Table 1. Experimental series 

































































t Uy t Uy t Uy t Ut t Ut t Uy t uu, 
1 14 | 26 12 | 51 21 76 | —77 | 101 12 | 126 | —51 | i561 | — 32 
2 20 | 27 51 | 52 62 77 | —32 | 102 56 | 127 | —67 | 152 | — 61 
3 —14 | 28 24 | 53 75 78 — 2] 103 —35 | 128 —84 | 153 —110 
+ —23 | 29 10 | 54 40 79 10 | 104 —89 | 129 —66 | 154 — 70 
5 | —37 | 30 19 | 55 21 80 22 | 105 | —29 | 130 | —38 | 155 | — 38 
6 | -—13 } 31 5 | 56 | —82 81 44 | 106 | —29 |] 131 | —26 | 156 | — 52 
7 47 | 32 | —26 | 57 | —89 82 68 | 107 | —46 | 132 68 | 157 | — 2 
8 61 | 33 —50 | 58 —49 83 41 108 —54 | 133 12 | 158 6 
9 73 | 34 —16 | 59 —41 84 26 | 109 — 37 134 — 5] 159 60 
10 76 | 35 —43 | 60 -—- 9 85 11 110 —22 | 135 32 | 160 70 
11 56 | 36 —52 | 61 38 86 —70 | lll 2 | 136 34 | 161 56 
12 54 | 37 —13 | 62 47 87 —35 | 112 4 | 137 25 | 162 — 16 
13 — 1] 38 0 | 63 59 88 —27 113 — 3] 138 42 | 163 19 
14 —63 | 39 20 | 64 15 89 — 4] 114 — 8 | 139 24 | 164 13 
15 —63 | 40 64 | 65 —10 90 15 | 115 | 9 |} 140 14 | 165 - ill 
16 16 | 41 52 | 66 — 24 91 43 | 116 —20 | 141 — 6 | 166 — 18 
17 22 | 42 48 | 67 24 92 = ute —54 | 142 —21 167 —- 2 
18 88 | 43 | 29 | 68 6 93 - 3 118 —55 | 143 —39 | 168 - 9 
19 99 | 44 5 | 69 37 94 2] 119 —64 | 144 —48 | 169 20 
20 79 | 45 —64 | 70 51 95 - 7 120 — 37 145 —14 170 33 
21 11 | 46 —97 | 71 24 96 | —?1 121 —12 | 146 16 | 171 76 
22 | — 6 | 47 | —68 | 72 4 97 | —38 | 122 36 | 147 10 | 172 48 
23 —39 | 48 —56 | 73 — 3& 98 —48 | 123 74 | 148 4 | 173 8 
24 —52 | 49 —25 | 74 —37 99 —66 | 124 25 | 149 10 | 174 - 6 
25 —42 | 50 1 | 75 —82 | 100 10 | 125 2 | 150 — 6] 175 — 49 
| 
For this series, « = — 1-4, 8 = 0-7 and ¢€ and 9 are discrete approximations to the normal variate, each 


with mean zero and standard deviation = 15; these values of a, 8, a(€) and N were chosen as being close 
to those for Wolfer’s series (according to Yule, 1927). The universe from which ¢ and 7 were drawn (by 
random numbers) was supposed to consist of 10,000 members each having one of the velues 0, + 1-5, 
+3-0,..., + 43-5, +45-Oand + 49-5, the number of members having each value being proportional to the 
normal probability-content of the interval of which that value is the centre (except for the extremes 
+ 49-5, which accounted for the balance of the probability outside + 45-0). Each u, was finally rounded 


off to the nearest integer. Actually 200 terms were calculated, but the first 25 were omitted from con- 
sideration. 
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Serial correlations up to the 12th were calculated, and are given in Table 2. The estimates a,, 8, obtained 
from the present method as well as from 7, 7, and 1, 7, 73 are set out in Table 3, and demonstrate the 


greater accuracy of the present method; it also appears that the exact form (9) gives values a little nearer 
the true ones than does (12). 


Table 2. Serial correlations of the experimental series 








k Tr, k Tr k TT, k Ty 

1 0-7349 4 — 0-3492 7 — 0-2432 10 0-4181 
2 0-3285 5 —0-4881 8 0-0261 1l 0-3934 
3 — 0-0475 6 — 0-4358 9 0-2852 12 0:2411 
































Table 3. Estimates of a (= — 1-4) and B (=0-7) 





























n=6 n=10 
a, Bb. a, B, 
Using the form (9) — 1-386 0-624 — 1-394 0-660 
Using the form (12) — 1-379 0-617 — 1-381 0-650 
| 





From 17;, 1: &, = — 1-073, 8, = 0-460. From 11, Te, 13: &, = — 1-258, B, = 0-627. 


Example 3. In view of the fact that the question of superposed variation in Wolfer’s series (annual 
figures given by Yule, 1927) was raised by Yule in his fundamental paper, it was thought worth while to 
investigate this series on the present lines. 

Both forms, (9) and (12), of the present method were used with n = 7 and n = 12, but as the difference 
between these was found to be slight, only the latter was used with n = 17 and 22. The results are given in 
Table 4. In this case the estimates from r,, r,, 73 are close to those given by the present method 
(a, = — 1-415, £, = 0-694). The period is obtained as 11-29 years, which is in fair agreement with the 
estimate of Larmor and Yamaga. 


Table 4. Estimates of the parameters of Wolfer’s series 





G=7 n= 12 a= 17 n= 22 





a, Bb. aX, Bb. a B, a, B, 











Using the form (9) —i-243 | 0-598 | —1-464 | 0-722 —- — — 5 
Using the form (12) | —1-248 | 0-603 | —1-461 | 0-718 | —1-419 | 0-696 | —1-415 | 0-694 



































From 1, 72: &, = — 1-346, 8, = 0-658. From 1, 1, 73: &, = — 1-389, 8, = 0-705. 


Table 5 gives the serial correlations* up to the 24th, both for the observed series and for the auto- 
regressive scheme fitted by the present method (using correlations) with n = 22. The two correlograms 
are shown in Fig. 1, where the solid line represents the observed and the broken line the estimated 
correlations. The fit is not very satisfactory, but considering the experimental evidence of Kendall 
(1946a), the discrepancy may be explained by chance variation. 


* The values of the first five correlations have also been given by Yule (1927), but they show a slight 
disagreement with mine. As, however, all my calculations have been checked, they should be correct. 
Moreover, the first correlation was specially recalculated ab initio, and was found to have the value 
previously obtained. 





lig 
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The observed and estimated lambdagrams (Yule, 1945) were also computed in order to throw more 

light on the question (Table 6, Fig, 2). Here again, the two differ considerably; but the misfit may be due 
to chance (cf. the results given by Kendall, 19455). 


Table 5. Observed (r,) and estimated (p,) serial correlations of Woifer’s series 


























k Tr Pr k Tr Pr k | Tr Pr 

1 08118 0-8353 9 0°-3566 0-0021 17 | — 00-2589 — 0-0452 
2 0°4346 0-4880 10 0-5085 0-0900 18 | —0-2062 —0-0371 
3 0-0316 0-1108 ll 05205 0-1259 19 | —0-1997 —0-0211 
4 — 0-2650 —0-1819 12 0-:3919 0°1157 20 | 0-0410 — 0-0042 
5 — 0-4046 — 0-3343 13 0:1754 0-0763 21 | 0-1307 0-0088 
6 — 0:3642 — 0°3468 14 — 0-:0403 0-0277 22 | 0-2197 0-0153 
7 — 00-1785 — 0-:2587 15 — 0-1944 —0-0138 23 0-:2228 | 0-0156 
8 0-1005 | —0°1254 16 — 0°2669 — 0:0387 24 0-1362 0-0114 








Table 6. Values of X,, (as defined by Yule, 1945) for Wolfer’s series 




















(observed) | (estimated) (observed) | (estimated) (observed) | (estimated) 
2 0-812 0-835 10 1-191 1-404 18 2-171 1-240 
3 1-372 1-439 1l 1-270 1-328 19 2-178 1-226 
4 1-668 1-796 12 1-423 1-284 20 2-174 1-212 
5 1-740 1-938 13 1-613 1-266 21 2-170 1-199 
6 1-652 1-921 14 1-800 1-261 22 2-180 1-187 
7 1-486 1-810 15 1-958 1-260 23 2-207 1-178 
8 1-317 1-662 16 2-071 1-257 24 2-250 1-171 
9 1-208 1-519 17 2-139 1-251 25 | 2-302 1-165 
| 


























The differences between the values of a,, 8, obtained from 7,, 7, and by the present method are such as 
would be caused by superposed variation in the series. But from the correlogram and lambdagram, it is 
evident that either the series is not sufficiently long for our purpose or the hypothesis regarding its nature 
is wrong. The latter seems possible, since the series consists of observations of a more or less continuous 
process at discrete points of time. It is proposed to consider, later on, the series of monthly numbers 
(giving more observations at shorter intervals), and try to ascertain whether other specifications such 
as those suggested by Spencer Smith (1944) and Bartlett (1946), fit the series better than the present one. 
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SUMMARY 


A method of estimating the parameters of an autoregressive time-series has been suggested and applied 
to three series. The method is based on the independence properties of the disturbance function and 
superposed variation which generate the series, and utilizes a number of serial correlations (or lagged 
product-sums) of the series for estimation. 

The results for the first two series (which are of known construction) are found to be satisfactory. As 
regards the third (sunspot numbers), it is doubtful whether this series is properly represented by an auto- 
regressive scheme of the type assumed. 
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A test for the serial independence of residuals 
By P. A. P. MORAN 
Institute of Statistics, Oxford University 


In economic problems we often wish to test the significance of a regression coefficient of one variate on 
another. If (x,,y;) (¢ = 1,...,”) is a sample of n pairs of values we may test the significance of the regres- 
sion of yon if we have reason to believe that the values of y are serially independent. But the y’s are often 
values of a time series which is serially correlated. To test whether this is so we may test the serial cor- 
relation coefficient (for references to the relevant theory see Moran (1948)) or, what is practically equi- 
valent, use von Neumann’s ratio. However, the serial dependence in the y’s may be due solely to their 
regression on the z’s if the latter are themselves serially correlated. The purpose of the present note is to 
set up a test for the serial independence of the residuals from the regression line. If the series are suffi- 
ciently long for the test to be reasonably sensitive, and if no serial dependence is indicated we may, with 
some assurance, use the residuals to provide an estimate of the standard error of the regression coefficient. 


rsity 
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The criterion used in the test is the first-order cyclic serial correlation coefficient of the observed 
residuals, and we determine its first and second sampling moments under the assumption that the true 
residuals are independently distributed in the same normal distribution. 

Suppose that the true regression of the variate y on z is given by 


Y=a+/X, 
n 
and suppose that in the sample n% = Xa, = 0. By choosing the origin of measurements for y we can 


arrange that a = 0. The true sample residuals, which we assume for simplicity to have unit variance, 





e then 
1 1: = Yi— Pay, 
and the observed residuals are €,=y;—-4 —ba,, 
1 n 
where 46=y9 =-Ly, 
"1 
n 
P| Laxey, 
b-+— 
n 
Lai 
1 
Also 7 = f+7] = 7] because % = 0. Then Ld 
B b 2a 
€; = 15-9 —-% n 
La 


We now consider the moments of the cyclic serial correlation coefficient 
n 
2 Ep Eg4y 
R, = ———, (1) 
de 
1 
n 
where €,,,, is defined to be equal to €,. Now it is known that © é is distributed as x? with n — 2 degrees of 
1 
freedom. R, is the ratio of a quadratic form in the ¢’s to another quadratic form which is distributed as x’. 
n 
It follows that (compare Koopmans, 1942) R, and > ¢? are distributed independently of each other and so 
1 


n > 
B {Ecce} 
7 —, p 
2{é a} 
1 


for any integer p. From this we can obtain the moments of R,. For the denominator we have 





(2) 


n 
a{ St} nocd (3) 
1 
n )2 
2{E¢} = n(n—2). (4) 
1 
: _ 224; 
Write B= La? ’ 


where (and subsequently) the symbol = indicates a sum taken from 1 to n unless otherwise indicated. 
We then have 
Les Es4. = Xl —9— 21 BY (1.4 — 7 — Xi41 B} 
= X95 —7) (N41 — 7) — BAA Ii41-1) 
— BIx,,1(9;— 7) + Bx, 2,41. 
Takin; tati find that =a, 
aking expectations we a nme...) < = 12 Ses, 
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since it may be easily verified that 


1 
En; —1) (Nix. — 7) -— (5) 
E(B*) = (Zaj), (6) 
E{B(y,—7)} = E(By,) = x (Zaz), (7) 
and therefore E(Ze;€;41) = —1—r x2) 


where r,(q) is the first-order cyclic serial correlation coefficient of the observed x’s, namely, 





= Lr, 41 
Ty) = <2 
1 
We thus have E(R,) =- ae (8) 


We now find the variance of R,. The awkwardness of the following calculations arises from the fact that 
unlike the situation in the corresponding argument used in a previous paper (Moran, 1948) the e; are not 


all on the same footing but have variances and covariances which depend on their suffixes. It is con- 
venient to write 


2 = 1-71. 
Then the z’s and B are distributed normally and we have 
n-1 
24) =——» 9) 
var (2,) = (9) 
@ latices wiboy 

cov (2,;2;) = oes if t+), (10) 
cov (Bz,) = x, Z2?)-1. (11) 


Using (6), (9), (10) and (11), and remembering that B and the z, are normally distributed about zero 
we have, from the consideration of the characteristic function of their joint distribution 





E(B) = mt 
BBs) = Sy 
E(B?) = Sto 
E(B*%,2,) = ~ spat ea if i+, 
E(B2) = er 
E(B2z,) = Se a if i+), 
E(Bz,z;z,) = oo if i,j, k are unequal. 


We must now evaluate 


E(Ze,€,,,)* = BX z (2, — Bay) (2441 — Bays) (2; — Bay) (244, — Bay,;) 
v 
=E£ 2 . 124244122 p 43 + BY, i 4105054, + B22, 244,054) 


+ B22 55 2544: %y Uy + 2B%Zy 254 Uppy, — 2BL p24 2 jE j4y 
— 2B 2525412 541%s — 2B 2H yy F 541 
— 2B 251 05044 0s + 2B% 2541244, 23}. 


= A, +Agt+Asy+Ay+Ag+Agt+A,+Agt+Ayt+ Arg, say. 


wh 


TI 








(5) 


(6) 
(7) 


(10) 


(11) 


zero 
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We evaluate each of these terms separately. 
n n 

(Aj) Ay = Dee te Deh tigat Le A412 2san 
1 1 


where the last sum is over all values of i and j such that the suffixes are unequal. Now 





n?+1 
ae 
E(z(% 41) = mm? 
n—3 
E (2,24 412142) = — =? 
E(2 52441252541) = ni 


There are n(n — 3) terms of the type 2;2;,12;2;4,, and adding the various terms together we get 


E(A,) = motine. 


In a similar manner we can prove by straightforward algebra the following results: 
E(A,) = 3r\@, 
E(A;) = 1+ 2ri(e 
E(A,) = 14 275, 
E(As) = — 2rya)+ 47a» 
E(Ag) = — 2+ 2rye— 2x2 


where ry, is the second-order serial correlation coefficient of the x’s, namely, 


n 
Dx Line 
1 





+. ’ 
X22 
1 

E(A,) = —2+ 27) — 2x2 

E(A,) = — 6ritas 

E( Ag) = — 6rices 

E( Ayo) = 2ry2)+ 4a 
Adding the above we obtain finally 





—2 
E(numerator)? = e- Set + 21 y¢) + 37 }(2) — We). 
n 
1 {(n—2)(n+1) 
We therefore have E(R}) = n(n—2) . + 210) + 377i) — 2x2) 
n+1 1 

7+ n(n—2) {21 ya) + 37a) — 2x0}, (12) 
and var (R,) = E( Ri) —{E(R,)}, (13) 


and is more easily calculated using this formula since E(R,) will have to be found in any case. By lengthy 
but elementary methods, the distribution of R, can be shown to tend to normality. 

The same method could be applied to the non-circular serial correlation coefficient, but it appears that 
this would result in rather more complicated formulae. 
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Efficiencies of certain linear systematic statistics for estimating dispersion 
from normal samples 


By K. R. NAIR 


In a recent paper Godwin (1949) evaluated the efficiencies of the following linear systematic statistics 
for estimating from a random sample of n observations, the standard deviation o of a normal population: 

(1) Mean deviation from the mean, denoted by m. 

(2) Mean deviation from the median, denoted by m’. 

(3) Range, denoted by w. 

(4) Quasi-ranges. 

He also obtained the expression for the most efficient linear systematic statistic (which he calls d) and 
calculated its efficiency for sample sizes n = 2 to 10. Godwin has therefore shown us the ‘ceiling’ values 
the efficiency of any linear systematic statistic can attain for normal samples. 

Seeing a large gap between the value of percentage efficiency of d and those of the statistics (1), (2), 
(3) and (4), Godwin felt that it should be possible to choose a linear systematic statistic which would be 
more efficient than (1), (2), (3) and (4) for practical work. I have recently shown (Nair, 1949) that in 
Gini’s mean difference, g, we have a linear systematic statistic which is almost as efficient as d. 

One argument which may be put forward against the use of g is that it involves more computation 
than the four statistics considered by Godwin. In this paper I have therefore examined a certain statistic 
which, although less efficient than g, is easier to calculate and which at the same time is more efficient 
than the four statistics referred to above. This new statistic is one suggested by the late Dr A. E. Jones 
(1946) for application to large samples, and I shall denote it by j in his memory.* 

If 21,2 ,..-,X, is a random sample of n observations arranged in ascending order of magnitude, we 


define 
je = = (x, +2 a-1t-- -+2 n—e+1) — (2p +2%,_ it.. - +2), (1) 


where 1 <r <}n or }(n— 1) according as n is even or odd. 

As pointed out in a previous paper (Nair, 1947), the range w and the mean deviation from the median 
m’ belong to the class of 7 statistics. 

The efficiency of 7, for normal samples is given by 


rin I) 1] It E(j2,) ] 
—1){-4 
[em 1 Tn) (BGe))® (2) 


Using the values of moments and product moments of rank differences in normal samples given by 
Godwin, values of (2) were calculated for n = 2 to 10 and for corresponding ranges of values of r. The 
efficiencies for jq) and j4n, (OT Jiyn—1) if 2 is odd) are the same as those of w anc i’, respectively, given by 
Godwin. 

In Table 1 are given values of the percentage efficiency of j,,, along with those relating to m, g and d. 








Table 1. Percentage efficiencies of various linear estimates of o in a normal population 


‘ | 








Statistic 2 3 4 5 6 | 7 8 9 10 
rT 

je) 1 100-00 | 99-19 97-52 95-48 93-30 91-12 89-00 86-9 85-0 

2 —_ |b — 91-25 93-84 95-71 96-67 96-97 96-8 96-4 

3 — _ -- — 90-25 91-78 93-56 95-0 95-9 

4 — — — — — — 89-76 90-7 92-2 

5 — — = — — — — — 89-4 

m 100-00 99-19 96-39 94-60 93-39 92-54 91-90 91-4 91-0 

g 100-00 99-19 98-75 98-50 98-34 98-24 98-16 98-1 98-1 

d 100-00 99-19 98-92 98-84 98-83 98-86 98-90 98-9 99-0 









































* Dr Jones met an untimely death in a lift accident on 7 May 1948 (see Editorial note on p. 283 of 
Biometrika, 35, 1948). 
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The magnitudes of the efficiencies lead to the ranking of the various statistics given in Table 2. 


Table 2. Ranking of various linear estimates according to percentage efficiency 





n Ranking 





d>g>w>m>m 
d>g>w>m>m 
d>g>jg>m>w>m’ 
d>g>jg>m>m >w 
d>g>jJy>jJgy>m>m >w 
d>g>Jj~a>Jey>m>m >w 
d>g>Jjy>Jg>J@>m>m >w 


OO OID OP bo 


_ 














It will be seen from Table 2 that w or jq) is the best statistic (apart from d and g) for sample size n = 2 
to 5. For n = 6 to 10, the statistic j,., is more efficient than m, m’ and w. The following are the factors by 
which jg) must be multiplied to make it an unbiased estimate of o:* 


n Factor n Factor 
4 0:37696 8 0-21970 
5 0-30157 9 0-20684 
6 0-26192 10 0-19684 
7 0-23702 


As n increases beyond 10, a stage will be reached when J) is the best statistic of the j-group, yielding place 
successively to 4,4), Jig), ete. 

Some idea of the efficiency of j,,, for large samples can be gained from Table 3 which is computed 
directly from Table 2 of Jones’s paper. Jones, basing his comparison on a table of standard errors rather 
than variances, had concluded that ‘efficiency is not much improved by increasing r/n beyond 4%’. 
This conclusion is perhaps a matter of opinion. Table 3 does not, however, help us to say at what value of 
r the efficiency of j,,, is a maximum for such large sample sizes as n = 100, 200, etc. 


Table 3. Percentage efficiency of j,, for large samples 








n 

r 100 200 400 600 800 1000 
5 71-4 54-1 37-7 31-1 26-0 21-9 

7 80-8 63-0 45:3 38-1 32-3 27-4 

10 —_ 71:8 53-2 45°5 39-1 33-5 
12 —_ 76-9 57-9 50-0 43-3 37-3 
16 = — 63-3 55-3 48-2 41-9 
20 —_ —_ 69-4 61-4 54-1 47-3 





























In conclusion, for small samples of size n < 10 it is certainly worth while calculating the 5 and 1 % points 
of g and jj. I hope someone will succeed in obtaining the exact sampling distributions of these two 
statistics and in working out their percentage points for normal samples. 


REFERENCES 
Gopw1iy, H. J. (1949). Biometrika, 36, 92. 
Jonss, A. E. (1946). Biometrika, 33, 274. 
Narr, K. R. (1947). Biometrika, 34, 360. 
Narr, K. R. (1949). Bull. Calcutta Statist. Ass. 2, 129. 
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Apparent correlation between independent series of autocorrelated observations 
By Sm GILBERT WALKER, C.S.I., F.R.S., Sc.D. 


In meteorology it is customary to examine the correlation between series of observations of various 
phenomena made at constant time intervals, in order to detect a possible causal connexion between them. 
Such series are likely to be themselves serially correlated, and this leads to an inflation of the sampling 
error of the estimated correlation between two of them. An example of the effect of serial correlation is 
the close relationship between the levels of big African lakes and sunspot numbers which held for a 
number of years and then disappeared (Walker, 1936). 

In order to throw light on the magnitude of the apparent correlation produced in this way, the sampling 
investigation described below was carried out. Specimen series were constructed with the aid of random 
numbers, and correlation coefficients between them were tabulated. At the time I had overlooked the 
fact that Bartlett (1935) had given a large-sample formula for the variance of the estimated correlation 
coefficient between two independent stationary Markoff series; he found that if p, and p, are the first- 
order serial correlation coefticients of the two series and r is the correlation between the two series 
calculated from n terms of each, 


It may, nevertheless, be worth while to record my empirical resu.ts, which are in good agreement with 
Bartlett’s formula. Orcutt & James (1948) also have used a similar empirical method in studying a 
related problem. 

The series used were constructed with the aid of the table of random normal deviates of Mahalanobis 
(1934). If we denote a series of these by u, Ug, ..., the series derived from them was v, = U4, V2 = U,+0°8r, 
Vs = Uz + 08g, ..., 80 that the correlation p between consecutive terms is 0-8 (which is typical for daily 
pressures). The whole series was split up into twenty-four series each of fifty readings, which may be 
denoted by (1), (2), ..., (24). These series were then taken in pairs in various ways and the correlation 
coefficient r was calculated each time. First, the twelve pairs (1) and (2), (3) and (4), ..., (28) and (24), 
were considered; then the following combinations: the ten pairs (1) and (6), (3) and (8), ..., (19) and (24), 
the eight pairs (1) and (10), (3) and (12), ..., (15) and (24), the six pairs (1) and (14), ..., (11) and (24), 
the four pairs (1) and (18), ..., (7) and (24), the two pairs (1) and (22), (3) and (24); and finally the’following 
combinations: the ten pairs (2) and (5), (4) and (7), ..., (20) and (23), the eight pairs (2) and (9), (4) and 
(11), ..., (16) and (23), the six pairs (2) and (13), ..., (12) and (23), the four pairs (2) and (17), ..., (8) and 
(23), the two pairs (2) and (21), (4) and (23). Thus seventy-two values of 7 were obtained. The ‘expected’ 
correlation between all pairs of series is effectively zero, being (0-8) = 1-4 x 10-5 for the first twelve pairs 
and less than this for the others. There is also a large measure of independence between the combinations 
used, so that the seventy-two coefficients calculated are very nearly independent of one another. It is not 
necessary that they should be strictly independent, as we are merely estimating expected frequencies. 

The values of r are shown in Table 1 below. Since magnitude only, not sign, is of interest, they have 
been entered without regard to sign. The variance of the values of r about 0 is 0-080, which is close to the 
value 0-091 given by Bartlett’s formula. 


Table 1. Correlation between two series of fifty readings 






































|r| Frequency |r| Frequency |r| Frequency 
0-00-0-04 9 0-25—0-29 12 0-50-0-54 1 
0-05—0-09 8 0-30-0-34 10 0-55-0-59 1 
0-10-0-14 6 0-35-0-39 3 0-60-—0-64 2 
0-15-0-19 8 0-40—0-44 1 
0-20-0-24 5 0-45-0-49 6 











To obtain similar information on the correlation between shorter series, the twenty-four original 
series of fifty readings were each split into two half-series of twenty-five readings. The same operations 
were performed on the first halves as have just been described for the whole series, and the same again 
was done with the second halves. Thus 144 correlation coefficients were obtained, and are given below in 
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Table 2. The variance of the values of r about 0 is 0-142, which is close to the value 0-182 given by Bartlett’s 
formula. 


Table 2. Correlation between two series of twenty-five readings 








|r| Frequency |r| Frequency |r| Frequency 
0-00-0-04 8 0-30—0-34 19 0-60—0-64 4 
0-05—0-09 16 0-35—0-39 16 0-65—0-69 4 
0-10—0-14 14 0-40—0-44 8 0-70—0-74 5 
0-15-0-19 9 0-45-0-49 7 0-75—0-79 1 
0-20-0-24 9 0-50-—0-54 7 0-80-0-84 0 
0-25-0-29 8 0-55--0-59 8 0-85-0-89 1 


























I am greatly indebted to Mr F. J. Anscombe for drawing my attention to the work of Bartlett and of 
Orcutt & James, as well as for aid in translating the dialect of the meteorologist into that of the statistician. 
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On the inversion of circulant matrices 


By I. J. GOOD 


1. In a recent paper concerning trend elimination (Quenouille, 1949) it is found necessary to invert 
matrices of the circulant form 


A={a,3 (¢=0,1,....n—1;7 =0,1,....n—1]), 


where the suffixes are reduced mod n. We shall call a matrix of this form a ‘circulix’ since its determinant 
is known as a ‘circulant’. The object of the present note is to describe an easy method for inverting 
circulices. The method depends on simple formulae which give the eigenvalues of A in terms of the 
elements of A and vice versa. A~! is, as a matter of fact, the circulix whose eigenvalues are the reciprocals 
of those of A. 
2. It is well known* and easily proved that the circulant | A | is given by the formula 
n-1 n-1 
jAj= Il Ya,w, 


s=0 r=0 
where w = exp (27i/n). i = ./(—1). Now | A—AI | is also a circulant, so the eigenvalues of A are 


e(A) = Da,w (s=0,1,...,.n—1). 
rT 


This is the ‘simple formula’ for the eigenvalues, mentioned above. If A is real and symmetrical,+ the 
case of interest to Quenouille, then the eigenvalues are real and can be computed, without using complex 
numbers, from one of the formulae 


—-1 yy 
a+2> a, cos —— +(— 1)*a,, (n even), 
ie r=1 nn, 
on Hin-1) Oars 
M+2 >) a,cos—— (n odd). 
r=1 n ‘ 


In this case e,_,(A) = e,(A). 


* See, for example, Encyc. Math. Wias. 1, 1, p. 43. 
+ So that, a, is real anda,_, = a, (r = 0,1,...,2—1). 
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3. It is also known* and easily proved that 
jy 2-1 
a,=— De(A)o-* (¢=0,1,...,.n—1). 
N r= 


Thus the elements of A are determined by the eigenvalues in almost the same way as the eigonvalues are 
determined by the elements. 
4. If A and B are circulices (of order n) then so are A+ B, A— B, AB and any polynomial in A. Since 


3] 
A-! = >) (I—A)*, 
m=0 
when the elements of I—A are sufficiently small, it follows that A-? is also a circulix, even if the elements 
of I—A are not small. (This can be more clumsily proved without limiting operations.) The eigenvalues 
of A+ B, A—B, AB, A-~ are respectively 
e,(A) + e,(B), e,(A) = e,(B), e,(A) e,(B), {e,(A)}-?. 

The first three of these assertions follow at once from § 2, while the fourth is deducible from the third by 
putting B = A-!, (It may be observed in passing that AB = BA.) 

Therefore in order to invert a circulix, A, we may proceed as follows: 

(i) Calculate the eigenvalues of A by using § 2. 
(ii) Calculate the reciprocals of these eigenvalues. 

(iii) This gives the eigenvalues of A-! and the elements of A-! may then be calculated by using § 3. 

If Aissymmetrical and real, then there is a considerable saving of calculation at stage (i), as pointed out 
in §2. Similarly, there is a considerable saving at stage (iii), since e,(A-") is real and e,_,(A-') = e,(A-). 

5. In the application A is symmetrical and real. Actually it is always possible to reduce the inversion 
to this case, even if A is complex. For AA’ = Bis always a real symmetrical circulix, where A’ is the 
complex conjugate of the transpose of A. Therefore B-! can be evaluated by the simplified calculation 
and A-! can be deduced from the formula A-! = A’B-}.’ Each matrix product here is a circulix product 
and involves only n scalar products of vectors. 

6. If, after stage (i), it is found that one of the eigenvalues is very small, it will become probable that 
the computation is ‘badly conditioned’. Since the eigenvalues are linear in the a, it is easy to calculate 
the effect of slight variations in the a,. The worst possible case would arise if variations in the a,, small 
enough to be within the range of experimental error, were sufficient to cause an eigenvalue to vanish, 
In this case A would be singular or nearly singular. Fortunately this type of case can be detected without 
finishing the whole calculation. 

7. Owing to rounding-off errors in the course of the calculation, the result may not be sufficiently 
accurate. The result, say C, will at any rate be a reasonable approximation to A-!. A very much better 
approximation may be obtained by calculating 2C — AC?, as in a known iterative method (for example, 
Hotelling (1943)) for inverting any symmetrical matrix. The method, being iterative, is self-checking. 
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The effect of non-normality on the z-test, when used to compare the 
variances in two populations 


By D. J. FINCH, University College, London 


1. Using the k-statistic technique, F. N. David (1949) has derived approximations to the moments of z 
when the two estimates of variance involved are based on independent samples from two populations. 
The only assumptions made regarding the functional form of the two populations are that, for each, the 
cumulants exist up to any order desired. From a knowledge of these approximate moments, David has 
discussed the effect of skewness on the distribution of the z criterion, Geary (1947) having previously 


* See, f-- example, H. Weyl (1931, p. 34), where the analogy with Fourier transforms is pointed out. 
t The i. 1 assertion may also be deduced from the fact that the eigenvectors of a circulix are 
independent of the circulix, being the columns of the matrix {w"*}. 
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discussed the effect of kurtosis. In this present note we discuss the effect of combined skewness and 
kurtosis on the distribution of z under the assumption that the hypothesis tested is true; having shown 
that skewness plus kurtosis gives results which differ little from those of kurtosis only, we then discuss 
the effect of kurtosis in the parent populations on the power of the test to detect differences in variance. 
The considerable effect of changes in the population £, has also been discussed by Pearson (1931, pp. 
129-31), who illustrated the position using the results of experimental sampling. 

2. Assume that the two parent populations are 7, and 7, defined by the cumulants k,,K», ...,K,, --+s 
Ky',Ko's ---»Ky,+-. respectively. The hypothesis we test is that x, = x,’. If there are two samples of sizes 
n, and n, randomly and independently drawn from 7, and 7, respectively, then the approximations to the 
moments of 


k 
z= flog, Ee 
as derived by David, are 


1 1 1 1 
E(z) = blog? — [Rerr | a [ sgl + 2A +47. 08 | : 
4 2 z 


1 1 
+ [sae (—4—84y,— 1607} — 407, + 4873 — 967/371 — 3776+ 96 ya Vi + 2474 72— 2078) | ’ 
, -2 


if 1 if _ na 
K(2) =7 , (2+%2) me 7a (— 8Y2— 274-871 + 572) = 


ry i 1 
+3 [ —8 + 168y_+ 120y, + 4807} — 15273 + 35257; + Ll yg — 967472 — 384271 + 12874) | , 


+2 


1fl . 
K,(2) = AE ~4+47i+7.- 990 | 
r -2 


1 


ifl 
+. 73(~80)1 2074+ 2478 — 967474 ~ 374+ 1207.71 + 307474~ 4472) | , 


4 1 
k,(z) = 16 [st 16 + 8y3 + 32737; — 48727 t+ Ye— 12ya¥et 207) | , 
+2 


1 
where r+2 = f+1 =, the sample size, and y, = k,,,/k}**!, and we use the notation ] for the value for 
the first sample plus or minus the value for the second sample. £2 

3. The case where the hypothesis tested is assumed true has first been considered. Thus we assume 
K, = K, and we make the further assumption that the two populations have the same functional form, so 
that «, = «kj, and we write this functional form as 





y=- 1 et (14 Max) 4 2H (X) * (A) 
(2m) “ 

where X = (x—<,)/./k, and H,(X) and H,(X) are the third and fourth Hermite polynomials. This popula- 
tion is completely specified from a knowledge of k,, K, K, and K,, the higher cumulants being 


Kg=0, Kg =—1OK3, Ky = 35k,Kk3, Ky = — 35x3. 


We approximate to the distribution of z with another Gram-Charlier series and illustrate the results for 


= 25, ny = 61. First we find 
the case n, = 25, ng eietaihinieans P{z>Zo05)> 


where 29.9; is the value of z cutting off 5 % of the area from the upper tail of the distribution of z when the 
parent population generating the sample is normal. For moderate degrees of skewness and kurtosis we get 
the results shown in Table 1. These results confirm those of both Geary & David and show that the effect 
of skewness in the parent population, either with or without an alliance with kurtosis, is negligible. The 
effect of kurtosis is, however, marked, and we shall therefore consider kurtosis only in our further in- 
vestigation. 


* Because such a representation of the population leads to negative frequencies we have been careful 
to avoid large divergencies from the normal, i.e. we have kept y, and y, small. For those cases considered, 
the negative frequencies play a negligible part. 
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Table 1. Probability corresponding to the 5% normal level of z, when the 
population is non-normal (n,= 25, n= 61) 


























Ys —1-0 —0-5 0 0-5 1-0 
Yi 
0 0-009 0-030 0-050 0-069 0-085 
0-1 0-009 0-031 0-050 0-069 0-085 
0:3 0-009 0-031 0-051 0:069 0-086 
0:5 0-009 0-032 0-051 0-069 0-086 











4. We begin by obtaining the power cf the z-test under the assumption that the parent populations are 
normal, but have different standard deviations. The full curves were worked out for various sample sizes. 
We give in Table 2 a selection of values for illustration. These values suggest that the power of the z-test 
for small samples is not large. 


Table 2. Probability of establishing significance at the 5% level, when the population variances differ 
(parent populations normal) 




































Sample 
sizes| %=17 m= 9 n,= 61 m= 9 n,=61 nm, = 25 m= 61 
N= 9 N,=17 N= 9 N= 61 Ng = 25 N= 61 n= 121 
1-5 0-142 0-172 0-143 0-211 0-294 0-338 0-576 
2-5 0-374 0-453 0-418 0-576 0-830 0-851 0-992 
3-0 0-484 0-566 0-555 0-699 0-935 0-941 0-999 








Table 3. Probability of establishing significance at the 5% level, when the population variances differ 


(parent populations not normal), n, = 25, n, = 61. 























eet 1-0 1-5 1-75 2-0 3-0 
a 

—1-0 0-009 0-319 0-511 0-711 0-980 

0 0-050 0-338 0-514 0-663 0-941 

1-0 0-086 0-355 0-500 0-624 0-896 














5. We now assume that the populations 7, and 7, are of the form of equation (A) above and are defined 
by the following values: 
Ky 1=9, Y2=4%, 
Ky n=9% Y=, 


that is to say we imagine two populations of the Gram-Charlier type which have zero skewness, and the 
same degree of kurtosis, but which have different standard deviations. For three values of @, i.e. 
a =—1-0, 0-0, + 1-0, the probability was calculated of detecting that there was a real difference in the 
population variances, when the hypothesis tested was that xk, = x3. Power curves were drawn and some 
selected values from these curves are given in Table 3. The sample sizes chosen are again n, = 25, n, = 61. 
The comparison of these curves is not immediate because of the bias introduced at the 5 % level of re- 
jection by the kurtosis in the parent population. The calculations accordingly were repeated, the level of 
rejection when the hypothesis tested is true being made 5 % for each case. These results are given in 
Table 4. 

6. It is clear that the z criterion used to test the hypothesis that the variances are equal in two parent 
populations is more powerful when these populations are platykurti¢ than when they are normal. From 
the point of view of choosing sample sizes before an experiment is carried out, in order to have a reasonable 
chance of detecting a given difference from unity in the ratio of the population variances (if it is present), 
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Table 4. Probability of establishing significance at the 5% level, when the population variances differ 
(level of rejection 5%), n, = 25, n, = 61. 
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2 Kali 1-0 1-5 1-75 2-0 3-0 

— 1 0-050 0-499 0-704 0-842 0-995 
0 0-050 0-338 0-514 0-663 0-941 
1-0 0-050 0-261 0-395 0-521 0-842 














it appears therefore that if the parent population is platykurtic, we shall be on the safe side. For if the 
difference may be detected with a given frequency in the normal case for given sample sizes, it may 
a fortiori be detected if the populations are platykurtic. In the planning of experiments, therefore, it is 
necessary to watch for possible leptckurtosis in the parent populations, because in this case larger sample 
sizes will be required to give the same power as in the normal case. 
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CORRIGENDA 


R. C. Geary and J. P.G. Wortitepcr. Biometrika (1947), 34, 104. 
In formula (3-9) for 3(b,), 
(a) Ist line: read 64,802-3°n1! not 64,802-3°n!. 
(b) 2nd line: in the coefficient of n’, read 74,020,787,452 not 74,020,784,452. 
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REVIEWS 


Rank Correlation Methods. By M.G. KENDALL. 160 pp. Charles Griffin & Co. Price 18s. 


This book consists of a collection of the researches which have been carried out on the measurement 
of the association between two variables, when all the information that is available is the relative order 
of the observations. Research into this problem was initiated mainly by Spearman, but has received 
considerable impetus of late chiefly from Prof. Kendall himself. The book has a twofold aim, as the 
reviewer sees it. First, it is desirable for the applied statistician to have the available techniques 
summarized and illustrated in such fashion that their application is easily intelligible. Secondly, to 
save the mathematical statistician time and labour in searching through the literature, it is desirable 
for the derivation of such techniques to be given fairly fully with references to relevant literature. 
Prof. Kendall succeeds admirably in both these aims, and he does so by dividing the book so that the 
application of techniques can be read without reference to the chapters on mathematical derivations. 
Such a division of spheres of interest is useful and helpful in any discussion on order statistics, since the 
application of such statistics is easy but the theory often very difficult. 

It is interesting to note in the univariate case, which Prof. Kendall does not touch upon, that while 
many order statistics have been proposed (all of which are easy to apply and interesting mathematically), 
yet it is rare indeed to find the need to use them in practice. It is customary to twist the observations 
about and/or to make various assumptions in order that existing techniques may be applied. This, 
the writer would suggest, is because of the instinctive feeling that tests based on ranks cannot be very 
discriminating. If, on the other hand, we consider the bivariate case, the order statistics proposed by 
Spearman and latterly by Kendall are used fairly frequently with little thought of the undoubted loss 
of information which using them implies. Is it that there is no alternative, or do we not know enough 
about bivariate techniques to try to do something better? Or is it that with bivariate techniques 
we are still wedded to the idea of description in a way which no longer applies in the univariate case? 

Mathematical statisticians will find Prof. Kendall’s book stimulating, in that it makes one aware 
of questions which may be raised and for which answers have not yet been found. Applied statisticians 
will find here all that they can be offered at the present in the way of techniques. 

F. N. DAVID 


Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability. 
Edited by J. NEyman. 501 pp. University of California Press. 1949. Price $7.50. 


At the close of the recent war a symposium was held at the Statistical Laboratory, University of 
California, Berkeley, with the idea of stimulating interest in normal peacetime research. To this end 
many papers were read which gave a picture not only of problems tc be met and worked out in the 
future, but which summarized research which had been done during the years which the locust had 
eaten. The idea of holding such a seminar was a valuable one, for many statistical research workers on 
both sides of the Atlantic who spent the war years with the mean and standard deviation and perhaps 
an occasional Poisson must have returned to academic work appalled by the amount of reading 
necessary to catch up with their more fortunate fellows. This was of course particularly true on this 
side. The carrying out of the idea seems to have been extremely fruitful. To take one isolated example, 
the paper by W. Feller contains a really excellent summary of the theory of the discontinuous Markoff 
type of stochastic process as Feller saw it in 1945. Such a paper is good for the beginner as well as for 
the research worker needing revision, and the book is worth buying for this paper alone. 

The width of interesting subjects covered during the symposium is noteworthy. Prof. Hotelling’s 
contribution on the place of statistics in the university, and the (printed) discussion which followed 
reads perhaps a little hollowly to us in England, who cannot do as we would like but must work as the 
changing face of adversity—in the form of too few teachers and too many students—permits. But it is 
interesting to read American views on this somewhat well-worn topic. The other contributions may be 
divided broadly into statistical theory and practice. On the theoretical side we have thoughts on the 
foundations of probability by Hans Reichenbach, and an interesting algebraic interpretation of a postula- 
tional characterization of statistics by A. H. Copeland. The most important of the remaining papers 
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would appear to the reviewer to be Prof. Neyman’s own contribution, on y* tests. He summarizes the 
properties of best asymptotically normal estimates and develops a class of x tests which are equivalent 
in the limit to the likelihood tests introduced by Neyman and Pearson in 1928. This paper may be 
contrasted with the paper of Feller. Both are valuable, Feller’s for its masterly summary and Neyman’s 
for its stimulating exposition of a new piece of theory. The other theoretical and the practical papers 
do not contribute a great deal to the corpus of statistical theory and practice, but they make interesting 
reading and would have been useful at the time at which they were written, for the purpose for which 
they were intended. 

Having said or implied that the book is stimulating and useful for all classes of statisticians to read, 
perhaps the reviewer may be permitted one or two minor grumbles. First, in such papers as the 
reviewer has worked through the misprints are many. Generally this does not matter, but in a few 
cases, for example, the domain of integration, a certain amount of anxious thought is required to 
establish that the printing is in error. Secondly, and this is important for English readers, the price 
is beyond the means of most students. This is a pity because, as has been said earlier, the book could 
be a useful introduction to statistical topics for many students, particularly those beginning to think 
about research. Finally, and this is a cry de profundis, the book has been delayed too long in publication. 
It would have saved much laborious work had Prof. Neyman published it in 1946. 

F. N. DAVID 
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